A multinational mass media and entertainment company seeks a Lead Data Engineer to lead the architecture, design and implementation of projects focused on collecting, aggregating, storing, reconciling and making data accessible from disparate sources to enable analysis and decision making. As an independent contributor, this individual will collaborate within a team of technologists to produce enterprise scale solutions to meet our clients needs.
REQUIREMENTS 6+ years of experience designing and implementing large-scale, complex, data-driven applications on the cloud, preferably on AWS. 6+ years of hands-on programming experience with Python, frameworks (Spark and Airflow) and streaming technologies (Kafka/Kinesis) 6+ years of hands-on experience using SQL to perform complex data manipulation 3+ years of experience modeling data warehouses (Kimball dimensional modeling) An understanding of technologies and design patterns in fields such as: microservices, streaming/queuing systems, key-value stores and high-performance solutions (vectorization, task and data parallelism) Ability to deal with ambiguity and work with rapidly-changing business data Appreciation of the need and ability to design for flexible systems that adapt to evolving user requirements Must have strong communication skills (written and verbal) NICE TO HAVE 1+ year of experience working on Snowflake Cloud Datawarehouse on AWS 1+ year of experience with graph database technologies (e.g., Neo4j, TigerGraph) 1+ year of experience building Master Data Management (MDM) solutions 1+ year of hands-on experience with R, Scala, Hive and/or Pig PREFERRED QUALIFICATIONS BS/MS/PhD in Computer Science or related field or equivalent experience. Associated topics: data analyst, data analytic, data center, data engineer, data integrity, data manager, data warehousing, database, mongo database, sql
* The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.