About the Raw Data Files (RDFs)

The raw data files (RDFs) are text files that you receive from Galileo once per day. These files contain low-level extracts of the prior day’s activity from Galileo's databases.

RDFs are securely delivered each day. With the RDFs you can build your own data store to compare with your production database, build statements and reports, and provide your customers with long-term transaction histories.

The standard suite of RDFs includes:

  • Customer Master — A list of primary accounts, their balances, and customer information
  • Account Card — A list of cards issued
  • Authorized Transactions — Authorization activity
  • Posted Transactions — Settlements, payments, adjustments, and fees
  • Lookup — A lookup file for the other RDFs

In addition to RDFs you can receive custom data files (CDFs). A few of the most commonly requested CDFs are:

  • Chargebacks and Disputes — Enhanced chargeback and dispute data beyond what the Posted Transactions RDF shows.
  • Overdraft — Enhanced overdraft data beyond what the Posted Transactions RDF shows.
  • Authorization Expiries — Unsettled authorizations that have expired from the authorization database.

If you need other data sets from Galileo, you can arrange for those files to be generated and made available through the same method as the RDFs.

📘

Note

RDFs and CDFs are available in ProductionProduction - The live Galileo environment where real transactions are performed. but not in CVCV - Client Validation. A test environment where you can test your implementation before moving it to Production..

Galileo has sample RDFs that you can see for example values and formats. In addition, you can ask for the Card Transaction Scenarios PDF from Galileo to see examples of how different transaction types are represented in the RDFs.

Accessing the RDFs

The RDFs are generated early every morning and contain activity from the previous calendar day, which on the Galileo system is from 00:00:00 (midnight) to 23:59:59 Arizona time (GMT -0700), a time zone that does not observe daylight saving time.

  • Because many different files are generated every day, availability times are staggered throughout the morning. Consult with Galileo for the times when you can expect your files to be ready.
  • On days when maintenance upgrades are performed, the availability time may be delayed.
  • In general, custom data files (CDFs) are available a few hours after the RDFs.

Galileo uses Secure File Transfer Protocol (SFTP) to deliver RDFs and CDFs. You can arrange to retrieve the files from Galileo's SFTP server or Galileo can push the files to your SFTP server. Coordinate with Galileo to get an account name and password.

RDF names have this format. The date represents the day when the file was generated, so a file that is dated 20211010 contains data from October 9, 2021:

  • accountcard_yyyymmdd.txt
  • authorizedtransactions_yyyymmdd.txt
  • customermasterfile_yyyymmdd.txt
  • lookup_yyyymmdd.txt
  • postedtransactions_yyyymmdd.txt

The files are PGP-encrypted using your public PGP key. RDFs are fixed-width files, which means that each field takes a fixed amount of space, including trailing spaces to pad out the field. CDF format varies by file: many are fixed-width, but some files, such as Secondary Accounts and Overdraft, are comma-separated values (CSVs). Galileo will provide you with a document that specifies the layouts for your program, including field sizes and data types. You can also access the latest version of your RDF layouts from the G-Analytics (Galileo Analytics) tool. Only the standard RDF layouts are available in G-Analytics.

If there is no activity in your program during a calendar day, you will receive RDFs that contain headers and footers but no records.

If there is a system or connectivity failure that prevents the RDFs from being delivered at the usual time, the RDFs will be delivered as soon as it is possible instead of waiting until the next day.

PCI compliance

Some of the fields contain PCI-sensitive information. If you are PCI compliant, you have the option of requesting that these values be masked or replaced by spaces. If you are not PCI-compliant, these values will be replaced by spaces:

  • CARD NUMBER (PAN)
  • ID or ID 2, when ID TYPE or ID TYPE 2 is SSN (Social Security number)
  • DATE OF BIRTH

Building a datastore

Galileo strongly recommends that you use the RDFs to create a datastore of transactions and customer records that is separate from the production database that you create from the Events API or Program API. (For more information on building a production database see the Transaction History guide.) Use the RDF-based datastore to:

  • Ensure that there are no missing or incorrect transactions in your production database. Where there are discrepancies between the RDFs and your records, you should consider the RDFs to be authoritative.
  • Run reports and perform data analysis, where large queries would overly tax the live production environment.
  • Produce longer-term transaction histories in your app or on your website instead of costly endpoint calls to Get Transaction History or other Program APIs.

Because RDFs are daily differential files instead of complete histories, you can read RDFs into your own data histories every day, which allows you to maintain a complete history by stitching together each day’s changes.

Keep in mind that when you are the system of record, the Galileo system may not have all of your transactions, depending on which transactions you report to Galileo. For example, Galileo may not have your card loads or other deposits.

Performing queries across tables

With each RDF in its own table you can perform complex queries. If you need to join two tables in a query, join on these two fields:

  • UNIQUE PROGRAM ID
  • GALILEO ACCOUNT ID

Building statements

See Creating Statements from the RDFs for instructions on using your RDF datastore to build customized statements for your customers.

RDF fields

Consult RDF Reference for individual field descriptions as well as other details about each RDF.


Did this page help you?