Data Engineer

4 days ago

Faridabad, India EXL Full time

Job DescriptionWe are looking for a Python & PySpark developer and data engineer who can design and build solutions for one of our Fortune 500 Client programs in the realm of Financial Master & Reference Data Management. This is high visibility, fast-paced key initiative will integrate data across internal and external sources, provide analytical insights, and integrate with the customer’s critical systems.Key ResponsibilitiesAbility to design, build and unit test applications on Spark framework on Python.Build Python and PySpark based applications based on data in both Relational (Oracle, SQL Server) and NoSQL database e.g. Redis, ValkeyBuild ingestion pipelines to load data into in-memory caching database.Build data pipelines to load and export data to/from the Master Data Management or Reference Data Management Platform using PySparkHands on experience doing at least one MDM implementation using TIBCO, Informatica, GoldenSource or custom-built MDM/RDM platformsExperience with designing/building Data APIs and its interaction with data consumersOptimize performance of the built Spark applications using configurations around Spark Context, Spark-SQL and Data Frame.Build Python programs using module libs e.g. pandas, requests, json, flask, pickleExperience in processing large amounts of structured data, including integrating data from multiple sources.Ability to design & build real-time applications using REST API, JSON, XMLAbility to build solutions on AWS services using Glue ETL, Lambda functions on PythonCreate and maintain integration and regression testing framework on Jenkins integrated with BitBucket and/or GIT repositoriesParticipate in the agile development process, and document and communicate issues and bugs relative to data standards in scrum meetingsWork collaboratively with onsite and offshore team.Develop & review technical documentation for artifacts delivered.Ability to solve complex data-driven scenarios and triage towards defects and production issuesParticipate in code release and production deployment.Challenge and inspire team members to achieve business results in a fast paced and quickly changing environmentRequirementsBE/B.Tech/ B.Sc. in Computer Science/ Statistics, Econometrics from an accredited college or university.Minimum 4 years of extensive experience in design, build and deployment of PySpark-based applications.Hands-on experience in Redis, Valkey, OpenSearch databaseIn-depth knowledge of Python core programming language – lists, dictionaries, tuplesExpertise on Python libraries e.g. pandas, requests, json, flask, pickleGood understanding on Informatica PowerCenter for building data pipelinesUnderstanding of Master Data Management processes & domain is preferred.Hands-on experience writing complex SQL queries, exporting, and importing large amounts of data using utilities.Ability to build abstracted, modularized reusable code components.Hands-on experience in generating/parsing XML, JSON documents, and REST API request/responsesHands-on experience in Redis, Valkey, OpenSearch databaseAble to quickly adapt and learn.Able to jump into an ambiguous situation and take the lead on resolution.Able to communicate and coordinate across various teams.Are comfortable tackling new challenges and new ways of workingAre ready to move from traditional methods and adapt into agile onesComfortable challenging your peers and leadership team.Can prove yourself quickly and decisively.Excellent communication skills and Good Customer Centricity.Strong Target & High Solution Orientation.

  • Senior Data Engineer

    4 days ago

    Faridabad, India Pacific Data Integrators Full time

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST)Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...

  • Data Engineer

    3 weeks ago

    Faridabad, India Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy Services!!Thank you for expressing your interest in exploring a career possibility with the TCS Family.We have a job opportunity for Azure Data Engineer at Tata Consultancy ServicesHiring For : Azure Data Engineer Mandatory Skills:Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, and Azure Databricks,...

  • Data Engineer

    4 days ago

    Faridabad, India Sirius AI Full time

    Data Engineer Job DescriptionAbout Sirius AISirius AI is a US headquartered AI Consulting services and products company with operations in India. Sirius AI focuses on Financial Services enterprises and solutions / services delivered across multiple geographies. We are an innovation-driven AI and data driven consulting services firm with a high focus on...

  • Data Engineer

    4 weeks ago

    Faridabad, India Sonata Software Full time

    Job Description Summary We are seeking a highly skilled Data Engineer to join our growing team. The ideal candidate has strong experience building and maintaining robust, scalable, cloud-native data pipelines and Datawarehouse using tools such as Snowflake, Five Tran, Airflow, and DBT. You will work closely with data analysts, scientists, and engineering...

  • Data Engineer

    5 days ago

    Faridabad, India IGT Solutions Full time

    Job Title: Senior Data EngineerExperience: 6 to 9 YearsLocation: Hybrid (Gurgaon)Employment Type: Full-timeJob Summary:We are seeking a highly skilled Senior Data Engineer with hands-on experience in Databricks, PySpark, ETL development, and SQL . The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and...

  • Data Engineer

    4 days ago

    Faridabad, India IGT Solutions Full time

    Job Title: Senior Data EngineerExperience: 6 to 9 YearsLocation: Hybrid (Gurgaon)Employment Type: Full-timeJob Summary:We are seeking a highly skilled Senior Data Engineer with hands-on experience in Databricks, PySpark, ETL development, and SQL . The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines...

  • Data Engineer

    23 hours ago

    Faridabad, Haryana, India Venture7 Technology Private Limited Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Job DescriptionWe are seeking experienced Data Engineers to join our dynamic team at Venture7 Technology Pvt Ltd.Key Responsibilities:Participate in design & develop high performance data & analytics productsParticipate in requirements grooming, analysis, and design discussions with fellow developers, business, and quality analystsParticipate in product...

  • Data Engineer

    2 days ago

    Faridabad, India Azilen Technologies Full time

    Job purpose:Manage and create design schema, SQL query tuning, and code review.Who you are:Min 4+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH developmentMin. 2 years of hands-on experience in SSAS tabular modelsDesigned Data Ingestion and Orchestration Pipelines with Kafka and PythonProven...

  • Data Engineer

    3 days ago

    Faridabad, India Azilen Technologies Full time

    Job purpose:Manage and create design schema, SQL query tuning, and code review.Who you are:Min 4+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH developmentMin. 2 years of hands-on experience in SSAS tabular modelsDesigned Data Ingestion and Orchestration Pipelines with Kafka and PythonProven...

  • Data Engineer

    4 days ago

    Faridabad, India NAB Full time

    Experience – 4 to 14 yearsSkills -• Proficient in executing ETL processes between data environments• Proficient at coding in SQL (additional knowledge in Python and R is highly regarded)• Proficient at creating analytics related documentation• Communication skills (written and verbal)• Stakeholder engagement skills• Commercial problem-solving...