Itheum Docs
Search
⌃K
Comment on page

Data Stream URL Rules

Specific rules relating to the URL

  1. 1.
    The URLs need to served via HTTPS (e.g. https://)
  2. 2.
    They can be "Unauthenticated" URLs if the data is non-sensitive.
  3. 3.
    They can also be "Authenticated" URLs if the data is sensitive as described in Guide 1 : Minting a Custom Data NFT Collection with Authenticated Data Streams (via SDK)​
  4. 4.
    They need to be "public" URLs and should be accessible on the World Wide Web
    1. 1.
      A) Unauthenticated URLs should always return the 200 OK HTTP Code​
    2. 2.
      B) Authenticated URLs should return the 403 FORBIDDEN HTTP Code if the authentication failed and 200 OK HTTP Code if the authentication scheme passes
    If you need any other HTTP code to be supported, reach out to us on Discord and we are open to discussing the use case.
  5. 5.
    If you are using a service like AWS S3 to host your URLs, it's recommended that you abstract the AWS S3 URL by putting domain name in front of it. This will future-proof your URLs and allow for the flexibility to move from AWS S3 to another origin. See Hosting : AWS S3 + Cloudflare to learn more
  6. 6.
    It is advisable to treat your Unauthenticated as "Unlisted" content URLs. A good example of "unlisted" content URLs are YouTube's "unlisted videos", where the videos are fully public but you can only reach them if you know the exact URL. To make them "Unlisted":
    1. 1.
      A) use a system like robots.txt or other such methods to prevent them from being indexed by search engines
    2. 2.
      B) Never publicly link to these URLs from your websites or apps
    3. 3.
      C) Make the URLs "random" (see next point)
  7. 7.
    To assist in making your URLs unlisted and un-guessable, it's best you have random paths in your URL. e.g. https://mydomain.bar/sdahjasdkkasd/hkkasdk2321313ka.json
  8. 8.
    Only have alphanumeric characters (a-z, 0-9) in your URL and do not include spaces or any symbols.
  9. 9.
    When you mint your Data Stream URL into a Data NFT, note that your URL is case sensitive as the Data Marshal considers origin URLs as case sensitive. e.g. https://mydomain.bar/sdahjasdkkasd/hkkasdk2321313ka.json and https://mydomain.bar/SDahjasdkkaSD/HKKasdk2321313KA.json are considered separate URLs
​

Other rules related to content served from the URLs (origin)

  1. 10.
    Although this is NOT released to URL standards, note that the current Data Marshal (V1 Achilles) can only support a maximum data payload of 4.5MB. Note that the next version of the Data Marshal (V2 Brontes) will have a much higher limit.
  2. 11.
    Your origin server can forward the following headers, which will be passed-through to your client app:
    1. 1.
      content-length
    2. 2.
      content-type
    3. 3.
      x-cache (bespoke header your can send to inform the client if a CDN-based origin HIT or MISSED. Example flags you can use)
    If you need any other pass-through headers supported, reach out to us on Discord and we are open to discussing the use case.
  3. 12.
    Your origin server can stream out any file type and indicate it via the content-type header; we've provided some code guidance on handling the following types which we've personally tested. (This is not an exhaustive list and other formats are also supported)
    1. 1.
      JSON
    2. 2.
      PDF
    3. 3.
      CSV
    4. 4.
      AUDIO (e.g. mp3)
    5. 5.
      TEXT
    6. 6.
      SVG
    7. 7.
      IMAGE (PNG, JPG, GIF)
​
Now, let's now jump into out platform specific guides of producing these Data Stream URLs...
Integrators - Previous
Data Streams Guides
Next
Amazon Web Services (AWS)
Last modified 2mo ago