Our ideal Advanced Data Engineer is a collaborative leader skilled in designing and constructing highly scalable data management systems. You re also committed to data integrity, are highly analytical, and can work on multiple projects at once. You ll use your skills to develop, monitor, and manage data systems across our platform. Additionally, you will act as a mentor to junior team members and coach them on best practices and engineering standards. The team culture of working collaboratively, cross-functionally, using new technologies combined with the work/life balance provided by MassMutual are core reasons people enjoy working on the Data Engineering team at MassMutual.
Objectives of this role:
* Design, construct, install, test and maintain highly scalable data management systems. * Ensure systems meet business requirements and industry practices. * Design, build, and maintain a high-performance streaming and messaging platforms to support the enterprise.
Daily and Monthly Responsibilities:
* Design, build, and maintain a high-performance streaming and messaging platforms to support the enterprise. * Create messaging standards for our messaging platforms. * Develop tools and processes to support the platform. * Create custom software components (e.g. specialized UDFs) and analytics applications. * Work across departments and business units to define patterns and data needs. * Translate high-level business requirements into technical specs.
* Bachelor s degree in computer science or engineering. * 3+ years of experience with designing and building data platforms. * 2+ years of experience with streaming/messaging platforms (Kafka, MQ, RabbitMQ, etc) * 2+ years of experience creating producer and consumer applications with Kafka * 2+ years of coding and scripting (Python, Java, Scala) and design experience. * Expertise in tuning and troubleshooting streaming/messaging platforms. * Experience with ELT methodologies and tools. * Strong data integrity, analytical and multitasking skills. * Excellent communication, problem solving, organizational and analytical skills. * Able to work independently. * Authorized to work in the USA with or without sponsorship.
* 3+ years of experience creating producer and consumer applications with Kafka * Experience with Spark * Experience with designing an automating deployment process (CI/CD) * Basic knowledge of database technologies (Vertica, Redshift, etc) Associated topics: data administrator, data center, data engineer, data management, database, database administrator, etl, erp, mongo database, mongo database administrator