
Senior ETL
3 days ago
About the Organisation
DataFlow Group is a pioneering global provider of specialized Primary Source Verification (PSV) solutions, and background screening and immigration compliance services that assist public and private organizations in mitigating risks to make informed, cost-effective
decisions regarding their Applicants and Registrants.
About the Role:
We are looking for a highly skilled and experienced Senior ETL & Data Streaming Engineer with over 10 years of experience to play a pivotal role in designing, developing, and maintaining our robust data pipelines. The ideal candidate will have deep expertise in both batch ETL processes and real-time data streaming technologies, coupled with extensive hands-on experience with AWS data services. A proven track record of working with Data Lake architectures and traditional Data Warehousing environments is essential.
Duties and Responsibilities:
- Design, develop, and implement highly scalable, fault-tolerant, and performant ETL processes using industry-leading ETL tools to extract, transform, and load data from various source systems into our Data Lake and Data Warehouse.
- Architect and build batch and real-time data streaming solutions using technologies like Talend, Informatica, Apache Kafka or AWS Kinesis to support immediate data ingestion and processing requirements.
- Utilize and optimize a wide array of AWS data services
- Collaborate with data architects, data scientists, and business stakeholders to understand data requirements and translate them into efficient data pipeline solutions.
- Ensure data quality, integrity, and security across all data pipelines and storage solutions.
- Monitor, troubleshoot, and optimize existing data pipelines for performance, cost-efficiency, and reliability.
- Develop and maintain comprehensive documentation for all ETL and streaming processes, data flows, and architectural designs.
- Implement data governance policies and best practices within the Data Lake and Data Warehouse environments.
- Mentor junior engineers and contribute to fostering a culture of technical excellence and continuous improvement.
- Stay abreast of emerging technologies and industry best practices in data engineering, ETL, and streaming.
Qualifications:
- 10+ years of progressive experience in data engineering, with a strong focus on ETL, ELT and data pipeline development.
- Deep expertise in ETL Tools: Extensive hands-on experience with commercial ETL tools (Talend)
- Strong proficiency in Data Streaming Technologies: Proven experience with real-time data ingestion and processing using platforms such as AWS Glue,Apache Kafka, AWS Kinesis, or similar.
- Extensive AWS Data Services Experience: Proficiency with AWS S3 for data storage and management Hands-on experience with AWS Glue for ETL orchestration and data cataloging. Familiarity with AWS Lake Formation for building secure data lakes. Good to have experience with AWS EMR for big data processing
- Data Warehouse (DWH) Knowledge: Strong background in traditional data warehousing concepts, dimensional modeling (Star Schema, Snowflake Schema), and DWH design principles.
- Programming Languages: Proficient in SQL and at least one scripting language (e.g., Python, Scala) for data manipulation and automation.
- Database Skills: Strong understanding of relational databases and NoSQL databases.
- Version Control: Experience with version control systems (e.g., Git).
- Problem-Solving: Excellent analytical and problem-solving skills with a keen eye for detail.
Communication: Strong verbal and written communication skills, with the ability to articulate complex technical concepts to both technical and non-technical audiences.
Preferred Qualifications:
- Certifications in AWS Data Analytics or other relevant areas.
-
Noida, Uttar Pradesh, India BOLD Full time ₹ 8,00,000 - ₹ 12,00,000 per yearBOLD is seeking an ETL Specialist who will help build the architecture and maintain a robust, scalable, and sustainable business intelligence platform. Assisted by the Data Team, this role will work with highly scalable systems, complex data models, and a large amount of transactional data.Job DescriptionABOUT THIS TEAMBOLD Business Intelligence(BI) team is...
-
Noida, Uttar Pradesh, India Bold Technology Systems Full time ₹ 20,00,000 - ₹ 25,00,000 per yearPosition OverviewThe role would be to help architect, build, and maintain a robust, scalable, and sustainable businessintelligence platform. Assisted by the Data Team this role will work with highly scalable systems, complex data models, and a large amount of transactional data.Company OverviewBOLD is an established and fast-growing product company that...
-
Senior SQL-ETL Developer
3 days ago
Greater Noida, Uttar Pradesh, India Coforge Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Location:- Greater NoidaExperience Required: 6-10 YearsMandatory Skills- SQL, SQL Migration, ETL, SQL Server, SQL queries/script writing function, Trigger and cursor, Data migrationsShift- UK ShiftContact-Email- Job Description:Design and implement database structures optimized for performance and scalability.Develop and maintain complex...
-
Senior Data Engineer – SSIS/SQL/ADF
1 week ago
Noida, Uttar Pradesh, India EICE Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Title -Senior Data Engineer – SSIS/SQL/ADFLocation -Noida, Sector 62 (Onsite)Experience -6+ YearsJob Summary:We are looking for a Senior Data Engineer with strong expertise in SSIS, SQL Server, and Azure Data Factory (ADF).The role involves maintaining and modernizing ETL pipelines, optimizing SQL workloads, and supporting the transition towards...
-
Senior Database Developer
5 days ago
Noida, Uttar Pradesh, India EICE Technology Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Title -Senior Database Developer (SQL Server, SSIS, Power BI, MS Fabric)Location - Noida, Sector 62Experience - 6+ YearsAbout the Role:We are seeking an experiencedSenior Database Developerwith strong expertise in SQL Server, SSIS, Power BI, and Azure Data Factory (ADF), along with working knowledge of Microsoft Fabric. The role involves designing,...
-
Senior Database Engineer
6 days ago
Noida, Uttar Pradesh, India Magicbricks Full time ₹ 6,00,000 - ₹ 18,00,000 per yearCompany DescriptionMagicbricks is India's No. 1 property site, providing a platform for buyers and sellers to locate properties of interest and find valuable information on real estate. With a vision to be the one-stop destination for all property needs, Magicbricks fosters a culture of innovation and excellence. Our dynamic environment challenges...
-
Senior Software Engineer
2 weeks ago
Noida, Uttar Pradesh, India R1 RCM Full time ₹ 12,00,000 - ₹ 36,00,000 per yearR1 RCM Inc. is a leading provider of technology-enabled revenue cycle management services which transform and solve challenges across health systems, hospitals and physician practices. Headquartered in Chicago, R1 is a publicly-traded organization with employees throughout the US and multiple INDIA locations.Our mission is to be the one trusted partner to...
-
Senior software engineer ii
6 days ago
Greater Noida, Uttar Pradesh, India HCL Technologies Ltd Full time ₹ 5,00,000 - ₹ 15,00,000 per yearJob Description Senior Software Engineer II Job SummaryLocation: Noida Project Role: Senior Software Engineer II Qualification: B-Tech Experience: 2.5-5 Years Skills: Javascript Secondary Skills:NoSQL NodeJS No. of Positions: 1 : Btech/BE in Computer Science or related technical field or proof of exceptional skills in related fields...
-
Senior software engineer ii
6 days ago
Greater Noida, Uttar Pradesh, India HCL Technologies Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Description Senior Software Engineer II Job SummaryLocation: Noida Project Role: Senior Software Engineer II Qualification: B-Tech Experience: Years Skills: Javascript Secondary Skills:NoSQL NodeJS No. of Positions: 1 Btech/BE in Computer Science or related technical field or proof of exceptional skills in related fields with...
-
Senior Data Engineer
6 days ago
Noida, Uttar Pradesh, India Iris Software Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDesign and develop robust data pipelines and ETL processesSupport data migration from traditional systems (Oracle, Vertica) to modern cloud platforms (Snowflake, AWS)Build and maintain scalable data ingestion and transformation frameworksOptimize and tune data queries for performance and efficiencyImplement and manage cloud-based data solutions (Snowflake,...