Job Description

Company Description

Pilot Flying J is the 10th largest privately held company in North America with more than 28,000 team members. As the industry-leading network of travel centers, we have more than 950 retail and fueling locations in 44 states and six Canadian provinces. Our energy and logistics division is a top supplier of fuel, employing one of the largest tanker fleets and providing critical services to oil operations in our nation's busiest basins. Pilot Company supports a growing portfolio of brands with expertise in supply chain and retail operations, logistics and transportation, technology and digital innovation, construction, maintenance, human resources, finance, sales and marketing.

Founded in 1958, we are proud to be family owned and consider our team members to be part of the family. Our founding values, people-first culture and commitment to giving back remains true to us today. Whether we are serving guests, a fellow team member, or a trucking company, we are dedicated fueling people and keeping North America moving.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status.

Pilot Flying J is part of the Pilot Company family of brands that keeps North America's drivers moving, including E-Z Trip, Mr. Fuel, One9 Fuel Stop, Pride, StaMart and Xpress Fuel.


Job Description

The purpose of this job is to provide technical expertise for research, development and modification of data engineering processes and jobs in support of a Big Data infrastructure for PFJ Energy in the commodities and energy space.

  1. Research, develop, document, and modify Date Engineering processes and jobs per data architecture and modeling requirements; collaborate with Data Analytics team members such as Data Strategists and Data Scientists
  2. Collaborate with business stakeholders to understand data needs, including data velocity, veracity, and access patterns
  3. Provide technical expertise to implement Data and Analytics specifications
  4. Serve on cross-functional project teams and provide perspective for the Data Analytics team on executing key deliverables
  5. Troubleshoot complex, escalated issues, including connection, failed jobs, application errors, server alerts and space thresholds within predefined service level agreements (SLAs)
  6. Proactively maintain and tune all code according to internally documented Data Engineering standards and best practices
  7. Review and ensure appropriate documentation for all new development and modifications of the Data Lake processes and jobs
  8. Perform code and process reviews and oversee testing for solutions developed, and ensure integrity and security of institutional data
  9. Educate business stakeholders on the usage and benefits of the data Lake/Lakehouse and related technologies
  10. Mentor and guide less experienced team members and provide feedback on project work
  11. Ensure all activities are in compliance with rules, regulations, policies, and procedures
  12. Complete other duties as assigned
  • Bachelor’s degree in computer science, engineering, information technology, or related field, required.
  • Bachelor’s degree in computer science, engineering, information technology, or related field, required.
  • Minimum eight years of technology operations experience required.
  • Experience in the commodities and energy space is required.
  • Strong SQL knowledge and skills required
  •  Strong knowledge of Relational Databases like Oracle, Postgres or SQL Server required
  • Experience with Apache Spark or Spark-streaming, Message Queue technologies and Python required
  • Strong knowledge of enterprise data warehouse (EDW) data models with a focus on Star Schema data modeling techniques required
  • Experience with unified data platforms such as Databricks or Snowflake preferred
  • Strong knowledge of Cloud Data platforms such as Amazon Web Services (AWS), Azure or Google Cloud preferred
Additional Information

All your information will be kept confidential according to EEO guidelines.


Application Instructions

Please click on the link below to apply for this position. A new window will open and direct you to apply at our corporate careers page. We look forward to hearing from you!

Apply Online