In this video Greg Panagiotatos, Senior Software Engineer for LexisNexis Risk Solutions, illustrates the use of the dfu-copy command line option which allows developers to utilize the DFU file service to copy and update data files to the HPCC Systems cluster without having to publish their query nor use the Roxie service to copy the data. This provides ECL developers better information about the data by creating publisher workunits that provide more granular information specifically about each of the data files being copied. This allows the developers to verify the integrity of the data deployed before actually publishing the query. Developers can then use the dfu-copy option to copy over any missing or incomplete data files only – instead of having to recopy all of the data over again as part of the publish process, and only publish the query after verifying the integrity of the data. This can be especially helpful for container or cloud HPCC Systems deployments as there are typically costs involved with various activities. Using the dfu-copy command line option makes publishing queries more efficient and helps to better manage cloud costs.
© 2024 LexisNexis Risk Solutions