Sr Data Engineer

Compensation

: $76,080.00 - $116,510.00 /year *

Employment Type

: Full-Time

Industry

: Information Technology



Loading some great jobs for you...





NTT DATA's Client is currently seeking a Sr Data Engineer with 7+ years of experience as a Data Engineer and has developed custom UDFs using both Data frames/SQL/Data sets in Spark for Data Aggregation, queries and writing data back into OLTP system.
Experienced in handling large datasets using Partitions, Spark in Memory capabilities, Broadcasts in Spark, Effective & efficient Joins, Transformations and other during ingestion process itself.
Developed a PAN tokenizer in Java using Protegrity API to mask PAN data available in different file formats e.g. Fixed format files, variable record files etc.
Ability to understand different encryption methodologies (symmetric/ Asymmetric/ tokenization/ masking /Hashing).
Ability to understand/Create regular expressions.
Understand different transport protocols (FTP/SFTP/REST/SOAP/CSV/Batch Files).
Additional plus, knowledge of Front-end caching cookies
Experience in working with EDW, Data masking, Data migration kind of projects
Experience in writing SQL or PL/SQL queries for various database
Hands on experience with scripting languages like python
Create subset plan and build subset queries for large databases more than 1000 tables
Exposure to Tools like Protegrity, Informatica
Nice to have
Implement tokenization and encryption solutions using various Protegrity protector components such as Application Protector, File Protector, Database Protector, Bigdata Protectors, etc.
Experience Protegrity is added advantage
Understanding of payer domain business process and application (custom or packaged application) to support testing activity like enrolment, quote to card, claim processing and payment etc.
Undergraduate Degree or Technical Certificate.
Graduate Degree preferred, BS in Computer Science (or related field)
The Company is an equal opportunity employer and makes employment decisions on the basis of merit and business needs. The Company will consider all qualified applicants for employment without regard to race, color, religious creed, citizenship, national origin, ancestry, age, sex, sexual orientation, genetic information, physical or mental disability, veteran or marital status, or any other class protected by law. To comply with applicable laws ensuring equal employment opportunities to qualified individuals with a disability, the Company will make reasonable accommodations for the known physical or mental limitations of an otherwise qualified individual with a disability who is an applicant or an employee unless undue hardship to the Company would result.

Job Requirements:

Associated topics: data architect, data center, data engineer, data integration, data manager, data management, data scientist, data warehouse, mongo database, teradata * The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.

Launch your career - Create your profile now!

Create your Profile

Loading some great jobs for you...