# Data Stream URL Rules ## Specific rules relating to the URL 1. The URLs need to served via HTTPS (e.g. https\://) 2. They can be "Unauthenticated" URLs if the data is non-sensitive. 3. They can also be "Authenticated" URLs if the data is sensitive as described in [Guide 1 : Minting a Custom Data NFT Collection with Authenticated Data Streams (via SDK)](/product-docs/pre-aithra/pre-aithra-developers/software-development-kits-sdks/data-nft-sdk/guide-1-minting-a-custom-data-nft-collection-with-authenticated-data-streams-via-sdk.md) 4. They need to be "public" URLs and should be accessible on the World Wide Web 1. A) Unauthenticated URLs should always return the [200 OK HTTP Code](https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/200) 2. B) Authenticated URLs should return the [403 FORBIDDEN HTTP Code](https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/403) if the authentication failed and 200 OK HTTP Code if the authentication scheme passes *If you need any other HTTP code to be supported, reach out to us on* [*Discord*](/product-docs/pre-aithra/pre-aithra-developers/tech-support-discord.md) *and we are open to discussing the use case.* 5. If you are using a service like AWS S3 to host your URLs, it's recommended that you abstract the AWS S3 URL by putting domain name in front of it. This will future-proof your URLs and allow for the flexibility to move from AWS S3 to another origin. See [Hosting : AWS S3 + Cloudflare](/product-docs/pre-aithra/pre-aithra-integrators/data-streams-guides/amazon-web-services-aws/hosting-aws-s3-+-cloudflare.md) to learn more 6. It is advisable to treat your Unauthenticated as "Unlisted" content URLs. A good example of "unlisted" content URLs are YouTube's "unlisted videos", where the videos are fully public but you can only reach them if you know the exact URL. To make them "Unlisted": 1. A) use a system like robots.txt or other such methods to prevent them from being indexed by search engines 2. B) Never publicly link to these URLs from your websites or apps 3. C) Make the URLs "random" (see next point) 7. To assist in making your URLs unlisted and un-guessable, it's best you have random paths in your URL. e.g. 8. Only have alphanumeric characters (a-z, 0-9) in your URL and do not include spaces or any symbols. 9. When you mint your Data Stream URL into a Data NFT, note that your URL is case sensitive as the Data Marshal considers origin URLs as case sensitive. e.g. and are considered separate URLs 10. Data Marshal starting V2 Brontes and above will also support `ipfs://{CID}` and `ipns:{HASH}` URLs ## Other rules related to content served from the URLs (origin) 10. Although this is NOT related to URL standards, note that the Data Marshal node (V1 Achilles) can only support a maximum data payload of 4.5MB but handle a lot of bandwidth request volume. Data Marshal node (V2 Brontes) can handle a much high limit data payload but may have some request bandwidth limitations for extreme high volumes. 11. Your origin server can forward the following headers, which will be passed-through to your client app: 1. content-length 2. content-type 3. x-cache (bespoke header your can send to inform the client if a CDN-based origin HIT or MISSED. [Example flags you can use](https://developers.cloudflare.com/cache/concepts/default-cache-behavior/#cloudflare-cache-responses)) *If you need any other pass-through headers supported, reach out to us on* [*Discord*](/product-docs/pre-aithra/pre-aithra-developers/tech-support-discord.md) *and we are open to discussing the use case.* 12. Your origin server can stream out any file type and indicate it via the content-type header; we've provided some [code guidance on handling the following types](/product-docs/pre-aithra/pre-aithra-developers/software-development-kits-sdks/data-nft-sdk/guide-2-unlocking-data-nfts-via-multiversx-native-auth.md#bonus-step-5-how-can-i-parse-non-json-data-streams) which we've personally tested. (This is not an exhaustive list and other formats are also supported) 1. JSON 2. PDF 3. CSV 4. AUDIO (e.g. mp3) 5. TEXT 6. SVG 7. IMAGE (PNG, JPG, GIF) {% hint style="info" %} On top of the above rules, it important to note that the Data Streams are "unlocked" via the [Data Marshal Network](/product-docs/pre-aithra/data-marshal-network.md) node network, so it's also important to understand some additional features/limitations the Data Marshal nodes may enforce on your Data Streams. Learn about these here: [Data Marshal Node Gateway Endpoints](/product-docs/pre-aithra/pre-aithra-developers/data-marshal-network/data-marshal-node-gateway-endpoints.md) {% endhint %} Now, let's now jump into out platform specific guides of producing these Data Stream URLs using various platforms and architectures... --- # Agent Instructions: Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://docs.itheum.io/product-docs/pre-aithra/pre-aithra-integrators/data-streams-guides/data-stream-url-rules.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.