Big Data Engineer


: $89,120.00 - $130,400.00 /year *

Employment Type

: Full-Time


: Information Technology

Loading some great jobs for you...

Immediate need for a talented Sr. Big Data Engineer with experience in the Energy/Utility Industry. This is a 12+ Months Contract opportunity with long-term potential and is located in Charlotte, NC. Please review the job description below,

Job ID: 20-12442

Job Title: Sr. Big Data Engineer

Location: Charlotte, NC

Duration: 12+ Months Contract

Job Description :

Our client is looking for a Sr. Data Engineer with extensive experience on the Hadoop platform related tools, and with leading teams to deliver complex products.

Key Responsibilities:

Build new data pipelines, identify existing data gaps, and provide automated solutions to deliver analytical capabilities and enriched data to applications.

Responsible for obtaining data from the System of Record and establishing real-time data feed to provide analysis in an automated fashion.

Develop Hadoop applications to analyze massive data collections

Develop processing framework to detect conditions

Develop techniques supporting trending and analytic decision-making processes

Apply Hadoop technologies for responsive front-end experience

Job Requirements:

Key Requirements and Technology Experience:

Bachelor s degree in computer science or a related discipline. In lieu of a degree, a minimum of 10 years of related business experience.

Work experience in addition to the degree: 5-10 years as an IT Application Analyst or equivalent

Proven experience within Hortonworks Hadoop ecosystems (MR1, MR2, HDFS, YARN, Hive, HBase, Sqoop, Pig, Hue, etc.)

Experience with relational SQL and NoSQL databases, including SQL Server and Cassandra.

3 to 5 years of Hadoop experience (Experience working on the Data and Analytics Solutions team):

  • Hive Programming
  • Sqoop (utilizing various data sources)
  • Oozie workflows
  • Spark/PySpark
  • HBase/Phoenix
  • MapReduce and Yarn
  • Hadoop File Formats (e.g. ORC; Parquet; Avro; JSON)
  • HDFS, Storm
  • Scala, C++, Python, Java
  • BitBucket/Jenkins
  • Experience with NiFi a plus
  • BitBucket and workflow scheduling tools such as CA ESP Automation
  • Familiarity with AWS stack a plus

Our client is a leading Energy/Utility Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.

Associated topics: data center, data manager, data scientist, data warehousing, database, database administrator, etl, erp, hbase, sql * The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.

Launch your career - Create your profile now!

Create your Profile

Loading some great jobs for you...