Id: 175877 Location: New York, NY Job Type: Direct Hire Job Description
Client is seeking a Senior Engineer to join Data Insights team. This role is a hands-on engineering position responsible for the build and continued evolution of a cutting edge data platform. This next generation data platform will include a modern data processing and data persistence pipeline including technologies such as Hadoop/Spark (S3 + EMR), and NoSQL. In addition to the technical contributions, this role will be responsible for technical leadership and system architecture within the Data Insights Team.
Real time data integration with AWS services involving message queues and streams: SQS, SNS and NoSQL data stores such as DynamoDB Design, develop, deploy and manage a reliable and scalable data analysis pipelines, using technologies including Python, Spark, Redshift and SQL Server Integration with 3 rd party vendors via Restful Web APIs and Flat files Experience designing systems that leverage serverless compute tools such as AWS Lambda Act as a mentor and thought-leader within your team and the Equinox engineering group Plan strategic initiatives and work with Directors and VPs to create roadmaps and define architecture Participate in cross-functional initiatives to develop new capabilities, including hands-on development responsibilities Ability to integrate data from a variety of sources, assuring they adhere to data quality and accessibility standards Document processes and standard operating procedures Evaluate and conduct POC's with new technologies
Bachelor's Degree Required: Computer Science or Engineering discipline preferred 5+ years technology experience working in an Engineering/Development/ Data Warehouse 5+ years developing with Python 3+ years working within a Data Warehouse environment 2+ years working with AWS public cloud (certification a plus) 2+ years working with MPP databases, distributed databases, and/or Hadoop Experience managing or leading small to medium sized engineering terms in dynamic environments Understanding of modern engineering design principles (distributed systems, stateless processes, etc) Understanding of Data Warehouse principles, including Kimbal-style Dimensional Modeling Creative, flexible, and quick to learn Work successfully in a multi-project, deadline driven environment, within Agile framework Expertise in SQL: 10 out of 10, SQL Ninja analytic capabilities, SQL ELT development and optimization on distributed systems. Experienced with NoSQL datastores & serverless environments Experience with Redshift a plus Experience with SQL Server a plus - provided by Dice Associated topics: data analyst, data analytic, data center, data engineer, data manager, data scientist, database administrator, etl, mongo database, mongo database administrator
* The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.