s3:start
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| s3:start [2021/11/07 18:52] – [CyberDuck] stalio | s3:start [2022/01/22 06:23] (current) – external edit 127.0.0.1 | ||
|---|---|---|---|
| Line 3: | Line 3: | ||
| ===== Overview ===== | ===== Overview ===== | ||
| + | LNGS decided to offer its users an object storage service for scientific data, with the idea of easing data archival and distribution for experiments and projects. | ||
| + | Object storage is a computer data storage architecture that manages data as objects, as opposed to other storage architectures like file systems which manages data as a file hierarchy, and block storage which manages data as blocks within sectors and tracks. Each object typically includes the data itself, a variable amount of metadata, and a globally unique identifier. | ||
| + | |||
| + | Object storage enables capabilities not addressed by other storage architectures | ||
| + | |||
| + | interfaces that are directly programmable by the application (APIs) | ||
| + | a namespace that can span multiple instances of physical hardware | ||
| + | data-management functions like data (geo)replication and data distribution at object-level granularity | ||
| + | authenticated, | ||
| Object Storage was designed to store very large amounts of unstructured data, i.e. data accessible with a unique ID and not through a complex structure with hierarchical folders. This structure allows you to access easily and very quickly all your static content such as photos, videos, text files, HTML and CSS web pages, etc. Access to your objects is performed using a standard HTTP API, meaning you can safely access your files easily from anywhere as authentication is usually required. | Object Storage was designed to store very large amounts of unstructured data, i.e. data accessible with a unique ID and not through a complex structure with hierarchical folders. This structure allows you to access easily and very quickly all your static content such as photos, videos, text files, HTML and CSS web pages, etc. Access to your objects is performed using a standard HTTP API, meaning you can safely access your files easily from anywhere as authentication is usually required. | ||
| LNGS decided to offer its users an object storage service for scientific data, with the idea of easing data archival and distribution for experiments and projects. | LNGS decided to offer its users an object storage service for scientific data, with the idea of easing data archival and distribution for experiments and projects. | ||
| - | |||
| ===== Access ===== | ===== Access ===== | ||
| Line 13: | Line 21: | ||
| The Amazon S3 Application Programming Interface (S3 API) is the most common way in which data is stored, managed, and retrieved by object stores. At LNGS the S3 API is a frontend API on top of the OpenStack Swift storage object engine. | The Amazon S3 Application Programming Interface (S3 API) is the most common way in which data is stored, managed, and retrieved by object stores. At LNGS the S3 API is a frontend API on top of the OpenStack Swift storage object engine. | ||
| - | After you are granted access to the Object Storage Service, you need to have a personal access_key and a secret_key to manage your data. Each user can own multiple access/ | + | After you are granted access to the Object Storage Service, you need to have a personal access_key and a secret_key to manage your data. Each user can own multiple access/ |
| ==== Obtaining credentials ===== | ==== Obtaining credentials ===== | ||
| - | To use the S3 API at LNGS_OSS, you need to get S3 credentials, | + | To use the LNGS Object Storage Service |
| In order to obtain S3 credentials you must to know the name of the project for which you need to obtain them. If you are entitled to access data belonging to different projects you will have to get different set of credentials for each project. Credentials can be obtained by logging in into linux.lngs.infn.it | In order to obtain S3 credentials you must to know the name of the project for which you need to obtain them. If you are entitled to access data belonging to different projects you will have to get different set of credentials for each project. Credentials can be obtained by logging in into linux.lngs.infn.it | ||
| Line 176: | Line 184: | ||
| Here is how you can mount an S3 bucket on owncloud: | Here is how you can mount an S3 bucket on owncloud: | ||
| - | {{: | + | {{ : |
s3/start.1636307550.txt.gz · Last modified: 2022/01/22 06:23 (external edit)
Page Tools
