Data Engineer
7 days ago
Position Overview:
We are looking for an experienced and driven Data Engineer to join our team. The ideal candidate will have a strong foundation in big data technologies, particularly Spark, and a basic understanding of Scala to design and implement efficient data pipelines. As a Data Engineer at CloudKeeper, you will be responsible for building and maintaining robust data infrastructure, integrating large datasets, and ensuring seamless data flow for analytical and operational purposes.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes to collect, process, and store data from various sources.
- Work with Apache Spark to process large datasets in a distributed environment, ensuring optimal performance and scalability.
- Develop and optimize Spark jobs and data transformations using Scala for large-scale data processing.
- Collaborate with data analysts and other stakeholders to ensure data pipelines meet business and technical requirements.
- Integrate data from different sources (databases, APIs, cloud storage, etc.) into a unified data platform.
- Ensure data quality, consistency, and accuracy by building robust data validation and cleansing mechanisms.
- Use cloud platforms (AWS, Azure, or GCP) to deploy and manage data processing and storage solutions.
- Automate data workflows and tasks using appropriate tools and frameworks.
- Monitor and troubleshoot data pipeline performance, optimizing for efficiency and cost-effectiveness.
- Implement data security best practices, ensuring data privacy and compliance with industry standards.
- Stay updated with new data engineering tools and technologies to continuously improve the data infrastructure.
Required Qualifications:
- 4- 6 years of experience required as a Data Engineer or an equivalent role
- Strong experience working with Apache Spark with Scala for distributed data processing and big data handling.
- Basic knowledge of Python and its application in Spark for writing efficient data transformations and processing jobs.
- Proficiency in SQL for querying and manipulating large datasets.
- Experience with cloud data platforms, preferably AWS (e.g., S3, EC2, EMR, Redshift) or other cloud-based solutions.
- Strong knowledge of data modeling, ETL processes, and data pipeline orchestration.
- Familiarity with containerization (Docker) and cloud-native tools for deploying data solutions.
- Knowledge of data warehousing concepts and experience with tools like AWS Redshift, Google BigQuery, or Snowflake is a plus.
- Experience with version control systems such as Git.
- Strong problem-solving abilities and a proactive approach to resolving technical challenges.
- Excellent communication skills and the ability to work collaboratively within cross-functional teams.
Preferred Qualifications:
- Experience with additional programming languages like Python, Java, or Scala for data engineering tasks.
- Familiarity with orchestration tools like Apache Airflow, Luigi, or similar frameworks.
- Basic understanding of data governance, security practices, and compliance regulations.
-
Systems Engineering Specialist
3 days ago
Noida, Uttar Pradesh, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per yearReq ID: 342029NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Engineering Specialist -Patching/Distribution SME to join our team in Noida, Uttar Pradesh (IN-UP), India (IN)....
-
Data Engineer
2 weeks ago
Noida, Uttar Pradesh, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole: Data EngineerExperience: 7 year+Location: Publicis Sapient(Pan India)Note: We need Immediate Joiner.Job Description:Primary Skills :Data Engineering – Data StreamingPython, Spark, Kafka, Spark Streaming, Databricks, Delta Lake, Azure (ADLS)We are looking for a Data Streaming Engineer to design, develop, and test real-time data pipelines leveraging...
-
Data Engineer
1 week ago
Noida, Uttar Pradesh, India GoodSpace AI Full time ₹ 9,00,000 - ₹ 12,00,000 per yearPosition:Data EngineerExperience:2–4 YearsLocation:Onsite, NoidaEmployment Type:Full-timeWe are looking for a skilled and motivated Data Engineer with 2–4 years of experience to join our team. The ideal candidate will be responsible for building, maintaining, and optimizing scalable data pipelines and infrastructure to support business intelligence,...
-
Data Engineer
2 weeks ago
Noida, Uttar Pradesh, India Microsoft Full time ₹ 15,00,000 - ₹ 25,00,000 per yearOn Team Xbox, we aspire to empower the world's 3 billion gamers to play the games they want, with the people they want, anywhere they want. Gaming, the largest and fastest growing category in media & entertainment, represents an important growth opportunity for Microsoft. We are leading with innovation, as highlighted by bringing Xbox to new devices with...
-
Data Engineer
3 days ago
Noida, Uttar Pradesh, India Delhivery Full time ₹ 15,00,000 - ₹ 25,00,000 per yearAbout Delhivery:Delhivery is India's leading fulfillment platform for digital commerce. With a vast logistics network spanning 18,000+ pin codes and over 2,500 cities, Delhivery provides a comprehensive suite of services including express parcel transportation, freight solutions, reverse logistics, cross-border commerce, warehousing, and cutting-edge...
-
Data - Engineer
1 week ago
Noida, Uttar Pradesh, India Iris Software Full time ₹ 1,00,00,000 - ₹ 2,50,00,000 per yearPosted On: 8 Oct 2025Location: Noida, UP, IndiaCompany: Iris SoftwareWhy Join Iris?Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture that truly values your talent and ambitions?Join Iris Software — one of the fastest-growing IT services companies —...
-
Systems Engineering Advisor
1 day ago
Noida, Uttar Pradesh, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per yearReq ID: 339179NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Engineering Advisor to join our team in Noida, Uttar Pradesh (IN-UP), India (IN). Systems Engineering Advisor...
-
Data Engineer
1 day ago
Noida, Uttar Pradesh, India ShyftLabs Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout ShyftLabsShyftLabs is a fast-growing data product company founded in early 2020, working primarily with Fortune 500 clients. We design and deliver cutting-edge digital and data-driven solutions that help businesses accelerate growth, improve decision-making, and create measurable value through innovation.Position OverviewWe're looking for an...
-
Data Engineer
1 day ago
Noida, Uttar Pradesh, India BIZ2X Platform Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are seeking a hands-on data engineer with a strong understanding of both data engineering and reporting. The ideal candidate will design and maintain data pipelines, curate analytical datasets, and build reports and dashboards that empower business stakeholders with insights. Youll work across ETL development, data modelling, and business reporting...
-
Data Engineer
2 weeks ago
Noida, Uttar Pradesh, India DigitalCube Consultancy Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Description : Job Title : Data EngineerExperience Required : 3-6 YearsResponsibilities : - Design, develop, and maintain scalable data pipelines and ETL processes to collect, process, and store data from various sources. - Work with Apache Spark to process large datasets in a distributed environment, ensuring optimal performance and...