Data Engineer
13 hours ago
Job Overview :
- The Data Engineer will be responsible for designing, developing, and maintaining data pipelines, ETL processes, and data infrastructure to support the Data Quality & Data Management Solution.
- This role ensures efficient data flow, transformation, and integration across multiple government and enterprise systems, while maintaining data accuracy, performance, and compliance.
Key Responsibilities :
- Design, build, and manage ETL pipelines for large-scale data ingestion, transformation, and integration.
- Develop and maintain data workflows to support the Data Quality & Data Management framework.
- Implement and optimize data migration and real-time data processing solutions for high-volume datasets.
- Integrate data from multiple sources including APIs, G2G, and G2C systems.
- Collaborate with architects and data quality specialists to align data flow with business and technical requirements.
- Manage data storage, replication, and performance tuning in big data and cloud environments.
- Ensure data security, encryption, and compliance with government and industry standards.
- Handle change requests, maintenance, and operational support for deployed data pipelines.
- Prepare and maintain documentation related to data workflows, configurations, and performance metrics.
Educational Qualifications:
- Bachelors or Masters degree in Computer Science, Data Engineering, or Information Technology.
- Preferred : Degree or specialization in Big Data Engineering or Cloud Engineering.
Professional Experience:
- Minimum 6 years of experience in Data Engineering.
- At least 3 years of experience in designing and implementing data pipelines for data quality management systems.
- Experience in at least 2 large-scale projects, preferably in government data registries, involving ETL, data ingestion, and massive dataset processing (40+ crore records).
- Proven experience in data migration, real-time data processing, and API/G2G integrations.
Technical Skills:
- Proficiency in ETL tools such as Apache Airflow, Talend, or Informatica.
- Strong knowledge of Big Data technologies like Hadoop, Spark, and Kafka.
- Hands-on experience in database management (SQL/NoSQL), and scripting using Python or Java.
- Experience with cloud storage and configuration as per RFP (e.g., AWS, Azure, or NIC Cloud).
- Proficiency in data transformation, error handling, and performance optimization for high-volume data.
- Knowledge of security practices, including encryption and compliance tools.
Certifications:
Required:
- AWS Certified Data Analytics Specialty or Google Professional Data Engineer.
Preferred :
- Certification in ETL tools (e.g., Talend Certified Developer) or Big Data technologies (e.g., Cloudera CCP Data Engineer).
Other Requirements:
- Strong collaboration skills with architects, data quality specialists, and project teams for smooth integration.
- Ability to manage operations and maintenance activities, including issue resolution and change requests.
- Excellent analytical, documentation, and communication skills.
-
Application Engineer
4 days ago
Delhi, Delhi, India Yotta Data Services Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob Location: Sarita Vihar, Delhi.Timings: 9.30 AM-6:30 PM, 5 days working (Saturday and Sunday Off)Job Description:Job Title: Application Support EngineerJob Summary:We are seeking an experienced Application Support Engineer to join our team. The successful candidate will be responsible for maintaining, monitoring, and troubleshooting 24x7 mission-critical...
-
Data Engineer
2 weeks ago
Delhi, Delhi, India ixceed Full time ₹ 30,00,000 - ₹ 45,00,000 per yearRole: Data Engineer (Python)Location: DelhiMode: PermanentType: HybridJob Description:We are looking for a highly motivated Data Engineer with a strong foundation in computer science and hands-on experience in Python and systems engineering. This role involves designing and developing data-driven applications, APIs, and interactive dashboards while applying...
-
Data Engineer
6 days ago
Delhi, Delhi, India Straive Full time ₹ 6,00,000 - ₹ 12,00,000 per yearCompany DescriptionStraive operationalizes Data Analytics and AI for global enterprises, including several Fortune 500 companies, to drive efficiency and enhance user experience. As a global leader in AI-driven value creation, Straive empowers diverse clients across industries such as Banking, Financial and Information Services, Retail, Media and Technology,...
-
Data Engineer
1 week ago
Delhi, Delhi, India SproutsAI Full time ₹ 20,00,000 - ₹ 25,00,000 per yearDescription : The Data Engineer will design, develop and maintain the data infrastructure for a healthcare organization. They will work with healthcare data, including EHR, HIMS, PACS and RIS. The ideal candidate should have experience in working with these systems and using SQL, Elasticsearch and data integration tools like Talend.Key responsibilities...
-
Data Engineer
2 weeks ago
Delhi, Delhi, India Weekday Full time ₹ 15,00,000 - ₹ 25,00,000 per yearThis role is for one of our clientsCompany Name: Industry: Technology, Information and MediaSeniority level: Mid-Senior levelMin Experience: 5 yearsLocation: NCRJobType: full-timeWe are seeking an experienced Data Engineer with deep expertise in the AWS data ecosystem to design, build, and optimize scalable data pipelines and platforms. The ideal candidate...
-
Data Engineer
1 week ago
Delhi, Delhi, India Iris Software Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per yearData Engineer We're hiring for the Role of Data Engineer. Mandatory skills : Databricks , Pyspark , Bigdata , Hadoop , Hive Experience: 5-9 Years Notice Period: IMMEDIATE to 15Days JOINERS only Interested candidate can send your CV.
-
Data Engineer
6 days ago
Delhi, Delhi, India Natlov Technologies Pvt Ltd Full time ₹ 9,00,000 - ₹ 12,00,000 per yearHiring: Data Engineer (AWS )Location:Remote |Shift:6 PM – 3 AM ISTJoinNatlov Technologies Pvt. Ltd.and be part of a dynamic data engineering teamWhat You'll DoBuild and optimize scalable data pipelines & modelsEnsure data quality, security, and performanceCollaborate across teams & mentor juniorsWork with modern tools like AWS, BigQuery, Snowflake,...
-
Data Engineer
3 days ago
Delhi, Delhi, India Environmental Resources Management Full time ₹ 9,00,000 - ₹ 12,00,000 per yearWho is ERM?ERM is a leading global sustainability consulting firm, committed for nearly 50 years to helping organizations navigate complex environmental, social, and governance (ESG) challenges. We bring together a diverse and inclusive community of experts across regions and disciplines, providing a truly multicultural environment that fosters...
-
Data Engineer
4 days ago
Delhi, Delhi, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a skilled Data Engineer / Database Administrator (DBA) to join our dynamic team at Talent Worx. This role involves designing, implementing, and maintaining database systems while ensuring data integrity and performance optimization. The ideal candidate will have a strong foundation in both data engineering and database...
-
Data Engineer
1 week ago
Delhi, Delhi, India ISITCA PRIVATE LIMITED Full time ₹ 8,00,000 - ₹ 12,00,000 per yearAbout the Role: We are looking for a hands-on Data Engineer to join our team and take full ownership of scraping pipelines and data quality. You'll be working on data from 60+ websites involving PDFs, processed via OCR and stored in MySQL/PostgreSQL. You'll build robust, self-healing pipelines and fix common data issues (missing fields, duplication,...