Senior Data Engineer

1 month ago

Gurugram, India Mrikal Full time

We are looking for a talented Data Engineer to join our team and play a pivotal role in designing, building, and maintaining the cloud-based data infrastructure for our clients. In this role, you will collaborate closely with data architects, analysts, and cross-functional teams to develop robust and scalable data pipelines, ensuring the seamless flow of data across various systems and platforms.


Responsibilities:

• Data Ingestion: Design and develop data ingestion pipelines to extract data from diverse sources, including databases, data lakes, and streaming platforms, into cloud-based data repositories.

• ETL/ELT Processes: Build and maintain ETL/ELT processes using cloud-native services and tools (e.g., Google Cloud Dataflow, Azure Data Factory, AWS Glue) to transform and load data into data warehouses or data lakes.

• Data Processing Workflows: Implement and optimize data processing workflows using distributed computing frameworks like Apache Spark, Apache Beam, or cloud-native services such as Azure Databricks, Google Dataproc, or Amazon EMR.

• Data Storage Solutions: Develop and maintain data storage solutions, including data lakes (e.g., Azure Data Lake Storage, Google Cloud Storage, Amazon S3) and data warehouses (e.g., Azure Synapse Analytics, Google BigQuery, Amazon Redshift).

• Collaboration: Work closely with data architects, data scientists, and analysts to understand data requirements and implement efficient data models and schemas.

• Data Quality: Ensure data quality, integrity, and security by implementing data validation, monitoring, and governance processes.

• Automation and Orchestration: Automate and orchestrate data pipelines using cloud-native tools (e.g., Azure Data Factory, Google Cloud Composer, AWS Step Functions) to ensure efficient and reliable data processing. • Optimization: Optimize data pipelines and infrastructure for performance, scalability, and cost-effectiveness, leveraging cloud-native services and best practices.

• Technical Support: Provide technical support and documentation for data processing solutions and infrastructure.

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

• Minimum of 2 years of experience as a Data Engineer, with a strong focus on cloud technologies.

• Proven expertise in at least one major cloud platform (Azure, GCP, or AWS) and its data services and tools. Preferably Google Cloud Platform (GCP), using services like Cloud Dataflow, Cloud Dataprep, Cloud Dataproc, and BigQuery.

• Proficient in Python, SQL, and scripting languages such as Bash or PowerShell.

• Experience with data processing frameworks and libraries like Apache Spark, Apache Beam, pandas, etc. • Knowledge of data warehousing concepts, data modeling techniques (e.g., star schema, dimensional modeling), and ETL/ELT processes.

• Familiarity with big data technologies and frameworks like Apache Hadoop, Apache Kafka, etc.

• Understanding of data governance, data security, and compliance best practices.

• Experience with containerization technologies like Docker and Kubernetes.

• Strong problem-solving, analytical, and troubleshooting skills.

• Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams. • Familiarity with agile methodologies and DevOps practices.


Preferred Expertise: While expertise in Google Cloud Platform (GCP) is preferred, candidates with experience in other cloud platforms like AWS or Azure will also be considered, as the core data engineering principles and technologies are transferable across cloud providers.


Why Join Us: At Mrikal, we pride ourselves on fostering a fun and inclusive culture that encourages creativity and innovation. As a Data Engineer, you'll have the opportunity to develop your skills, contribute to impactful projects, and be part of a team that values creativity, collaboration, and continuous learning.


About Mrikal: Mrikal is a leading product studio specializing in digital solutions across Pharma, Retail, Oil & Gas, and Edtech industries. Our multidisciplinary team excels in design, development, deployments, data engineering, and AI. We are committed to delivering world-class solutions through good architecture, data practices, embedded AI, user empathy, and growth hacks.

  • Senior Data Engineer

    2 weeks ago

    Gurugram, India INFONET Full time

    Company DescriptionInfoNet provides customized software solutions for businesses of all sizes, from startups to Forbes 500 enterprises. Since 1996, we've been dedicated to helping companies streamline operations, enhance customer experiences, and drive growth with cutting-edge technology. Our team of developers, engineers, and consultants delivers tailored...

  • Senior Data Engineer

    3 days ago

    gurugram, India INFONET Full time

    Company DescriptionInfoNet provides customized software solutions for businesses of all sizes, from startups to Forbes 500 enterprises. Since 1996, we've been dedicated to helping companies streamline operations, enhance customer experiences, and drive growth with cutting-edge technology. Our team of developers, engineers, and consultants delivers tailored...

  • Senior Data Engineer

    4 weeks ago

    Gurugram, India Coforge Full time

    Job Title: Data EngineerSkills: Scala, Airflow, Spark, Scala, Hive, Hadoop & Data Engineering ConceptsExperience:Location: GurugramMode of Work: Hybrid We at Coforge are hiring Senior Data Engineers with the following skillset:Worked in a data engineering team environment of at least 5 engineers (agile, version control, etc.).Built and maintained at least...

  • Senior Data Engineer

    4 weeks ago

    Gurugram, India Coforge Full time

    Job Title: Data EngineerSkills: Scala, Airflow, Spark, Scala, Hive, Hadoop & Data Engineering ConceptsExperience:Location: GurugramMode of Work: Hybrid We at Coforge are hiring Senior Data Engineers with the following skillset:Worked in a data engineering team environment of at least 5 engineers (agile, version control, etc.).Built and maintained at least...

  • Senior Data Engineer

    1 month ago

    Gurugram, India Zupee Full time

    Senior Data EngineerWe are the biggest online gaming company with largest market share in the Indian gaming sector’s largest segment — Casual & Boardgame. We make skill-based games that spark joy in the everyday lives of people by engaging, entertaining, and enabling earning while at play.In the three plus years of existence, Zupee has been on a mission...

  • Senior Data Engineer

    1 month ago

    Gurugram, India Zupee Full time

    Senior Data EngineerWe are the biggest online gaming company with largest market share in the Indian gaming sector’s largest segment — Casual & Boardgame. We make skill-based games that spark joy in the everyday lives of people by engaging, entertaining, and enabling earning while at play.In the three plus years of existence, Zupee has been on a mission...

  • Data Engineer

    4 weeks ago

    Gurugram, India NTT DATA Services Full time

    Req ID: 282638 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Gurgaon, Haryāna (IN-HR), India (IN).Data EngineerJob SummaryWe are...

  • Senior Data Engineer

    3 weeks ago

    Gurugram, India True Tech Professionals Full time

    Job Title: Senior Data EngineerLocation: Gurgaon (Hybrid)Experience Required: 6 to 9 yearsJob Summary:We are seeking a highly skilled Senior Data Engineer with expertise in PySpark, Python, ETL processes, and data pipeline development. The ideal candidate will have a strong background in Snowflake and hands-on experience working with AWS cloud. You will be...

  • Senior Data Engineer

    3 weeks ago

    Gurugram, India True Tech Professionals Full time

    Job Title: Senior Data EngineerLocation: Gurgaon (Hybrid)Experience Required: 6 to 9 yearsJob Summary:We are seeking a highly skilled Senior Data Engineer with expertise in PySpark, Python, ETL processes, and data pipeline development. The ideal candidate will have a strong background in Snowflake and hands-on experience working with AWS cloud. You will be...

  • Senior Data Engineer

    3 weeks ago

    Gurugram, India True Tech Professionals Full time

    Job Title: Senior Data Engineer Location: Gurgaon (Hybrid) Experience Required: 6 to 9 years Job Summary: We are seeking a highly skilled Senior Data Engineer with expertise in PySpark, Python, ETL processes, and data pipeline development. The ideal candidate will have a strong background in Snowflake and hands-on experience working with AWS cloud. You will...

  • Senior Data Engineer

    3 weeks ago

    Gurugram, India Coforge Full time

    Job Title: Data Engineer Skills: Scala, Airflow, Spark, Scala, Hive, Hadoop & Data Engineering Concepts Experience: Location: Gurugram Mode of Work: Hybrid We at Coforge are hiring Senior Data Engineers with the following skillset: Worked in a data engineering team environment of at least 5 engineers (agile, version control, etc.). Built and maintained...

  • Senior Data Engineer

    3 days ago

    gurugram, India Coforge Full time

    Job Title: Data Engineer Skills: Scala, Airflow, Spark, Scala, Hive, Hadoop & Data Engineering Concepts Experience: Location: Gurugram Mode of Work: Hybrid We at Coforge are hiring Senior Data Engineers with the following skillset: Worked in a data engineering team environment of at least 5 engineers (agile, version control, etc.). Built and maintained...

  • Senior Data Engineer

    3 days ago

    gurugram, India Coforge Full time

    Job Title: Data EngineerSkills: Scala, Airflow, Spark, Scala, Hive, Hadoop & Data Engineering ConceptsExperience:Location: GurugramMode of Work: Hybrid We at Coforge are hiring Senior Data Engineers with the following skillset:Worked in a data engineering team environment of at least 5 engineers (agile, version control, etc.).Built and maintained at least...

  • Senior Data Engineer

    3 months ago

    Gurugram, India The Economist Full time

    Introduction Job Title: Senior Data Engineer Business Unit: Technology / Engineering Location: London Direct Reports:  0 Reporting Manager Title: Bogdan Vrusias Date Prepared: 01 / 05 / 2024 Who we are We are an organisation that exists to drive progress. That's the “red thread” that connects everyone at The Economist Group...

  • Senior Software Engineer

    1 month ago

    Gurugram, India Real Time Data Services Full time

    We are seeking a talented and motivated Senior Software Development Engineer to join our dynamic engineering team. As a Senior Software Development Engineer, you will play a crucial role in the development of web applications and services using technologies & frameworks such as Node.js, React.js, Next.js, Nest.js, PHP, Mysql, MongoDB, Microservices pattern....

  • Senior Software Engineer

    1 month ago

    Gurugram, India Real Time Data Services Full time

    We are seeking a talented and motivated Senior Software Development Engineer to join our dynamic engineering team. As a Senior Software Development Engineer, you will play a crucial role in the development of web applications and services using technologies & frameworks such as Node.js, React.js, Next.js, Nest.js, PHP, Mysql, MongoDB, Microservices pattern....

  • Senior Software Engineer

    1 month ago

    Gurugram, India Real Time Data Services Full time

    We are seeking a talented and motivated Senior Software Development Engineer to join our dynamic engineering team. As a Senior Software Development Engineer, you will play a crucial role in the development of web applications and services using technologies & frameworks such as Node.js, React.js, Next.js, Nest.js, PHP, Mysql, MongoDB, Microservices pattern....

  • Senior Data Engineer

    1 month ago

    Gurugram, India Invokhr Full time

    Desired Experience: 3-8 years Salary: Best-in-industry Location: Gurgaon ( 5 days onsite) Overview: You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position,...

  • Senior Data Engineer

    6 days ago

    gurugram, India MakeMyTrip Full time

    Position: Senior Data Engineer II Experience: Must have 4+ years of experience About Role: We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences. About us: Nurtured from the seed of a single great idea - to empower the traveler - MakeMyTrip...

  • Senior Data Engineer

    3 days ago

    gurugram, India MakeMyTrip Full time

    Position: Senior Data Engineer IIExperience: Must have 4+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the traveler - MakeMyTrip went...