Engineer I, Big Data


: $81,980.00 - $121,090.00 /year *

Employment Type

: Full-Time


: Information Technology

Loading some great jobs for you...

The purpose of this job is to research, develop, document, and modify extract, transform, load processes and jobs in support of a Big Data infrastructure, as well as data warehouse (EDW) for Pilot Flying J. Focus will be on Enterprise AWS Cloud environment, with an emphasis in EMR and Redshift.

1. Research, develop, document, and modify Big Data processes and jobs according to data architecture and modeling requirements, and processes set forth by Business Intelligence (BI) Data senior team members

2. Maintain accountability for completing key EDW/Data Lake project activities; communicate project status and risks to project leader

3. Troubleshoot issues including connection, failed jobs, application errors, server alerts, and space thresholds within predefined service level agreements (SLAs)

4. Proactively maintain and tune code according to EDW/Big Data best practices

5. Review and ensure appropriate documentation for all new development and modifications of the Big Data processes and jobs

6. Perform unit testing for solutions developed, and ensure integrity and security of institutional data

7. Under the guidance of lead data team members, take technical specifications and complete development per specifications.

8. Model behaviors that support the company s common purpose; ensure guests and team members are supported at the highest level

9. Ensure all activities are in compliance with rules, regulations, policies, and procedures of the organization

10. Complete other duties as assigned


Bachelor s degree in computer science, engineering, information technology or related field preferred (Masters Preferred)

Qualifications, cont.

Minimum 1-3 years technology operations experience required

Specialized Knowledge

Strong SQL knowledge and skills required

Knowledge of Postgres and SQLServer preferred

Familiarity with AWS or similar data platform required

Knowledge of ETL tools such as Informatica or Datastage a plus

Familiarity with Enterprise Data Warehouse data models with a focus on Star Schemas preferred

Experience with Spark/Spark-streaming, Python, Hive, Kafka preferred

PFJ institutional knowledge preferred

5508 Lonas Rd

Job Requirements:

Associated topics: data architect, data center, data engineer, data integration, data warehouse, database administrator, erp, mongo database administrator, sql, sybase * The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.

Launch your career - Create your profile now!

Create your Profile

Loading some great jobs for you...