Data Engineer - Fahrenheit IT (Flushing)

Compensation

: $94,330.00 - $148,460.00 /year *

Employment Type

: Full-Time

Industry

: Information Technology



Loading some great jobs for you...





Id: 175877 Location: New York, NY Job Type: Direct Hire Job Description

Client is seeking a Senior Engineer to join Data Insights team. This role is a hands-on engineering position responsible for the build and continued evolution of a cutting edge data platform. This next generation data platform will include a modern data processing and data persistence pipeline including technologies such as Hadoop/Spark (S3 + EMR), and NoSQL. In addition to the technical contributions, this role will be responsible for technical leadership and system architecture within the Data Insights Team.

RESPONSIBILITIES

Real time data integration with AWS services involving message queues and streams: SQS, SNS and NoSQL data stores such as DynamoDB
Design, develop, deploy and manage a reliable and scalable data analysis pipelines, using technologies including Python, Spark, Redshift and SQL Server
Integration with 3 rd party vendors via Restful Web APIs and Flat files
Experience designing systems that leverage serverless compute tools such as AWS Lambda
Act as a mentor and thought-leader within your team and the Equinox engineering group
Plan strategic initiatives and work with Directors and VPs to create roadmaps and define architecture
Participate in cross-functional initiatives to develop new capabilities, including hands-on development responsibilities
Ability to integrate data from a variety of sources, assuring they adhere to data quality and accessibility standards
Document processes and standard operating procedures
Evaluate and conduct POC's with new technologies

Qualifications

Bachelor's Degree Required: Computer Science or Engineering discipline preferred
5+ years technology experience working in an Engineering/Development/ Data Warehouse
5+ years developing with Python
3+ years working within a Data Warehouse environment
2+ years working with AWS public cloud (certification a plus)
2+ years working with MPP databases, distributed databases, and/or Hadoop
Experience managing or leading small to medium sized engineering terms in dynamic environments
Understanding of modern engineering design principles (distributed systems, stateless processes, etc)
Understanding of Data Warehouse principles, including Kimbal-style Dimensional Modeling
Creative, flexible, and quick to learn
Work successfully in a multi-project, deadline driven environment, within Agile framework
Expertise in SQL: 10 out of 10, SQL Ninja analytic capabilities, SQL ELT development and optimization on distributed systems.
Experienced with NoSQL datastores & serverless environments
Experience with Redshift a plus
Experience with SQL Server a plus - provided by Dice
Associated topics: data analyst, data analytic, data center, data engineer, data manager, data scientist, database administrator, etl, mongo database, mongo database administrator * The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.

Launch your career - Upload your resume now!

Upload your resume

Loading some great jobs for you...