Data Engineer w/ Streamsets
Compensation: $106,390.00 - $159,250.00 /year *
Employment Type: Full-Time
Industry: Information Technology
Title : Data Engineer w/ Streamsets Location: Montvale, NJ Position Type : Contract NEED 8+ A strong technically-oriented individual to work as a Data Engineer with St= reamsets experience or deep interest a plus for a requirement with below ex= pectations: * Design, build, and deploy new data pipelines within Big Data = Eco-Systems * Documents new/existing pipelines, Data Sets and Data Sets * Abides by department development standards and SOP''s. * Attends all department meetings * All other duties as assigned. * Keeps updated on latest technologies relevant to position''s d= uties. * Has great knowledge of commonly used software concepts and de= sign * Great understanding of the development lifecycle * Keeps management updated on projects and assigned work Technology and Traits: * Linux * Hadoop (hdfs, hive, spark, sqoop) * SQL and HiveQL * noSQL (Mongodb, Cassandra, or Couchbase) * Neo4j * Git * Python or Scala, Java * ESSENTIALS -> STREAMSETS * Bonus: Kafka, Kinetica * Excellent written and verbal communication skills * Excellent troubleshooting ability * Strong work ethic and positive attitude. * Professional demeanor * Ability to work under stressful situations. * Mentally strong and able to cope with many challenges. * Performs and completes variety of tasks under a fast-paced en= vironment. * Excellent troubleshooting and verbal and written communicatio= n skills. * Commitment to the success of assigned projects, co-workers an= d the company. Experience: * At least 4 years experience of designing, building, and deplo= ying production-level data pipelines using tools from Hadoop stack (Hive, S= park, Sqoop * Preferred: Cloudera Certified Data Engineer, i.e. CCP Data En= gineering Exam * At least 4 years experience with various noSQL databases (Mon= goDB, Couchbase, Cassandra, Neo4j) * At least 2 years experience with SQL databases and Change Dat= a Capture * At least 5 years experience with production-level programming= (python or scala or java) * At least 4 years experience troubleshooting JVM-related issue= s * Experience and strategies to deal with mutable data in Hadoop= is preferred * Experience with Kafka, Kinetica, Streamsets preferred * Understanding and experience of Agile and DevOps methodologie= s preferred
Associated topics: data administrator, data engineer, data integrity, data management, data quality, data warehouse, data warehousing, database, mongo database, sql
Associated topics: data administrator, data analyst, data center, data engineer, data integrity, data quality, data scientist, data warehouse, data warehousing, hbase
* The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.
Loading some great jobs for you...