Data Engineer

Applied Thought Auditors & Consultants in Chicago, IL

  • Industry: Information Technology - Data Architect/Analyst/Administrator
  • Type: Full Time
  • Compensation: $91,730.00 - 131,820.00 / Year*
JOB DESCRIPTION The Data Engineer will collaborate with various other IT groups, business partners and external service providers and play a key role in the design, development and operations of our new analytics platform, the ldquo(ZDP)rdquo. Job Responsibilities Include Participate in Requirements Gathering work with key business partner groups (e.g. Product Mgt) and other Data Engineering personnel to understand department-level data requirements for the ZDP Design Data Pipelines work with other Data Engineering personnel on an overall design for flowing data from various internal and external sources into the ZDP Build Data Pipelines leverage standard toolset and develop ETLELT code to move data from various internal and external sources into the ZDP Support Data Quality Program work with Data QA Engineer to identify automated QA checks and associated monitoring alerting to ensure ZDP maintains consistently high quality data Support Operations triage alerts channeled to you and remediate as necessary Technical Documentation leverage templates provided and create clear, simple and comprehensive documentation for your development Key contributor to defining, implementing and supporting Data Services Data Dictionary Tool Standards Best Practices Data Lineage User Training Skills Responsibilities Strong ELT ETL designerdeveloper Strong SQL Strong Python Structured unstructured data expertise Cloud environment development operations experience (e.g. AWS, GCP) Preference for candidates experienced with Google Cloud Platform (GCP) and associated services e.g. BigQuery, GCS, Cloud Composer, Dataproc, Dataflow, Dataprep, Cloud PubSub, Metadata DB, Data Studio, Datalab, other Other important tools Apache Airflow (scheduler), Bitbucket and git (version control), Stackdriver (ops monitoring), Opsgenie (alert notification), Docker Real-time data replicationstreaming tools Data Modeling Excellent verbal and written communications Strong team player Success Criteria Strong analytical thinking and problem solving skills Superior communication and business-technical interaction skills Positive, ldquoget it donerdquo attitude Ability to multi-task and manage multiple activities with varying timelines To qualify, you must possess the following skills Bachelorrsquos degree in computer science, management information systems, or a related discipline 5+ years hands-on ETLELT designdevelopment experience Key resource on team(s) that have delivered successful enterprise-level analytics platformsPandoLogic. Category: Technology, Keywords: Data Engineer
Associated topics: data administrator, data analyst, data center, data integration, data management, data quality, database, etl, hbase, mongo database administrator

* Estimated salary


You may be interested in these similar jobs near Chicago, IL!

Data Scientist / Data Engineer
Terminal Contacts LLC

Position Data Scientist Data Engineer Location Chicago, IL Duration Long Term Contract Fulltime Job Description Senior data scientist engineer Prefer…

Read More
Cloud Data Engineer
Apex Systems

Cloud Data Engineer Permanent Multiple Locations Our client is looking to hire multiple Cloud Data Engineer's for permanent opportunities supporting …

Read More
Azure Big Data Engineer
Spout IT

Greetings, Job Title Lead Azure Big Data engineer Job Location Chicago, IL Job duration Long Term Contract Requirement Hands-on experience in dealing…

Read More
Sr. Data Engineer/Scientist
GlobalSource IT

GlobalSource IT has a new Direct Client's need in the Chicago, IL area for a unique Sr. Data EngineerScientist. This opportunity is for a Senior reso…

Read More
Sr. Data Engineer
Green Key Resources

Green Key Resources is currently in search of a Sr. Data Engineer for a large eCommerce Company in Chicago, IL. This is a 6-12month Contract position…

Read More
Sr. Big Data Engineer / Lead / Architect
Multivision Inc-IL

Sr. Big Data Engineer Lead Architect Location Elmhurst IL Duration Long Term 10+ years of experience working with enterprise data platforms, building…

Read More
Data analyst
Ampstek LLC

Data Analystchicago,IL12 Months Required SkillsetMinimum of 1-5 years of hands-on experience with the following1. Working in the following areasa. Da…

Read More
Senior Data Engineer. FTE. Oak Brook, IL. (L-3672) (B)
LEVERAGEncy LLC dba Amplified Sourcing

Highlighted Skills Data Engineering,Are you open to direct hire after some time? (not required client likes those open to the potential contract only…

Read More
Data Engineer
Discover

**Please note that we are unable to provide visa sponsorship now or in the future for this opportunity***As a Data Engineer, you will design & develo…

Read More