Manager - Data Engineer

2 months ago

Udaipur, India Career Stone Consultant Full time

Manager Data Engineering


ABOUT THE JOB Role: Manager Data Engineering Reports to: AD - Data Engineering

Location: Gurgaon

Responsibilities

● As a Data Engineering Manager, you will play a pivotal role in designing the architecture, guiding the development and optimisation of data pipelines and tools. You will mentor the team in building code to efficiently extract raw data, ensuring its quality through robust validation techniques, and leveraging your extensive data expertise to guarantee accurate data ingestion across the pipeline. Your leadership will be instrumental in transforming raw data into formats that are compatible with downstream data sources.

● In this role, you will provide strategic oversight for the development of data tools that are critical for transforming, managing, and accessing data. You will also advise the team on best practices for writing and validating code to ensure the resilience and reliability of data storage platforms.

● You will lead the implementation of performance monitoring protocols across data pipelines, guiding the team in building effective visualisations and aggregations that monitor pipeline health. Additionally, you will coach the team on developing and implementing solutions and self-healing processes that minimize points of failure across various product features.

● Your expertise in data governance will be crucial as you help identify needs and oversee the design of data modelling and handling procedures that ensure compliance with relevant laws and policies. You will also ensure that data accessibility is maintained within your assigned pipelines.

● Collaboration with the Data Science team will be key as you work together on feature set requirements and prediction pipelines. You will prepare team members for meetings with key stakeholders, addressing concerns around data requirements and providing expert guidance on feature estimation. Additionally, you will assist in evaluating data costs, access, usage, dependencies across products, and availability for business or customer scenarios related to one or more product features. Required Knowledge and Skills:

● Data Engineering Tools: Proficiency in ETL/ELT processes, with experience in tools such as Apache Spark, Flink, Kafka, and Airflow.

● Programming Languages: Expertise in programming languages like Python, SQL, and Scala for data processing and analysis.

● Cloud Platforms: Strong experience with cloud-based data services such as AWS, Google Cloud Platform, or Azure.

● Data Warehousing: In-depth knowledge of data warehousing solutions like Snowflake, Redshift-Athena, or BigQuery.

● Visualisation Tools: Experience with data visualisation tools such as Tableau, Power BI, or Looker. ● Pipeline Monitoring: Knowledge of monitoring and alerting tools like Prometheus, Grafana, or Datadog.

● Lake house file formats: Knowledge and experience of working with various storage formats like AVRO, HUDI, parquet, orc and delta.

● API design and development: experience in designing, implementing, and optimising REST APIs, including hands-on expertise in developing robust, scalable, and secure API solutions like flask, Django or fastapi.

  • Lead Data Engineer

    2 weeks ago

    Udaipur, India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Data Engineer

    2 months ago

    Udaipur, India Acuity Knowledge Partners Full time

    We are looking for a senior data engineer who will help us source, validate, and manage financial data using state-of-the-art data mining algorithms. The role involves leveraging the latest data mining techniques, designing validation engines, error monitoring, and conducting root cause analysis. The candidate will also be responsible for statistical...

  • Data Engineer

    1 month ago

    Udaipur, India SourceBae Full time

    Job Role: Senior Data Infrastructure EngineerExperience 5+ yearsLocation: RemoteDuration:3 - 6 monthsJob DescriptionTitle: Senior Data Infrastructure EngineerAbout the roleAs a Senior Data Infrastructure engineer, you will be working with Data Engineering, Analystand Operations teams to build and maintain a secure, scalable and reliable data platform...

  • Data Pipeline Engineer

    2 weeks ago

    Udaipur, Rajasthan, India Kadel Labs Full time

    About Kadel Labs: Kadel Labs is a leading software technology systems incubator.Job Title: Associate Software Engineer (Data Engineering)Location: FlexibleJob Type: Full-timeJob Summary:We are seeking a highly skilled Associate Software Engineer to join our data engineering team. The ideal candidate will have experience with designing, building, and...

  • Data Engineer with Cloud Expertise

    4 weeks ago

    Udaipur, Rajasthan, India iitjobs, Inc. Full time

    Role Overview:Greetings, we're seeking a talented Sr. Data Engineer with expertise in GCP and ETL to join our team at iitjobs, Inc.Key Responsibilities:Design and implement scalable data pipelines using GCP services such as Dataflow, DataProc, and Bigquery.Develop and maintain efficient ETL processes using Python and Java.Collaborate with cross-functional...

  • Data Engineer

    2 months ago

    Udaipur, India Expand My Business Full time

    Details Contract : 6 months to start with.Experience 4-6yrs of experienceLocation: Onsite (Bangalore)Joining : Within 15 days.Basic QualificationsBachelor's degree in Computer Science, Information Technology, or a related field.Proven experience as a Data Engineer with expertise in ETL techniques (2+ years) is a MUSTStrong programming skills in languages...

  • Data Engineer

    2 weeks ago

    udaipur, India Syptus Full time

    Company DescriptionSyptus is a technology marketing agency creating software solutions for the marketing and advertising industry. We are currently looking to hire a dynamic, enthusiastic and hard working Engineer with min 1 yr. experience in the field of Data Engineering.Role DescriptionThis is a full-time, fully remote role for a AWS Cloud Data Engineer...

  • Manager - Research (Technology Domain)

    3 months ago

    Udaipur, India Data Security Council of India Full time

    Job Title: Manager - ResearchReports to: DirectorJob Overview:The Research Manager will be responsible to continuously scan the cyber security industry in and from India. The role plays an important role in developing and executing plans of engagement around content/research, and engaging CXOs/decision-makers/communities. An ideal candidate should have...

  • Sr. Data Engineer with SPARK and Airflow

    2 weeks ago

    udaipur, India iitjobs, Inc. Full time

    Greetings!!!Role:- Sr. Data Engineer with SPARK and AirflowLocation- 100 % RemoteDuration:4 Months ContractTiming- 1 pm to 10 pmImmediate JoinerMust have skills:3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.Good experience on SPARK and AirflowStrong knowledge of relational databases like SQL Server, PostgreSQL,...

  • Zeno Health | Senior Data Engineer | udaipur

    1 week ago

    udaipur, India Zeno Health Full time

    Job Description:We are seeking a highly skilled Lead Data Engineer with a strong background in Python, SQL, and modern big data technologies. The ideal candidate will have a proven track record in designing and implementing scalable data pipelines, managing ETL processes, and leveraging diverse data storage and processing frameworks, including relational and...

  • Search engine optimization manager

    2 weeks ago

    Udaipur, India Indian Institute Of Organics Full time

    We are seeking a dynamic and results-driven SEO Manager to join our marketing team. The ideal candidate will have a deep understanding of search engine optimization strategies, a passion for data analysis, and a proven track record of improving organic search performance. You will be responsible for developing and implementing effective SEO strategies to...

  • Engineering Manager

    3 weeks ago

    Udaipur, Rajasthan, India Accor Full time

    Job Overview:We are seeking a highly skilled Engineering Executive to join our team at Fairmont Udaipur Palace.Main Responsibilities:Plan daily engineering staff briefings with the Director of Engineering and distribute daily work assignments.Schedule and document planned and unplanned maintenance programs for various systems, including air-conditioning,...

  • Engineering Manager

    1 month ago

    Udaipur, Rajasthan, India AccorHotel Full time

    Job SummaryWe are seeking a highly skilled Engineering Executive to join our team at AccorHotel. As a key member of our operations team, you will be responsible for ensuring the smooth operation of our facilities and equipment.Key ResponsibilitiesPlan and coordinate daily engineering staff briefings with the Director of Engineering.Assist in distributing...

  • Big Data Solutions Architect

    4 weeks ago

    Udaipur, Rajasthan, India ATech Full time

    About the RoleWe are seeking an experienced Cloud Data Engineer to join our team at ATech. As a Cloud Data Engineer, you will be responsible for designing, building, and optimizing data models and ETL processes based on our clients' business requirements.Key ResponsibilitiesDesign, build, and optimize data models and ETL processes using Spark, Scala, and...

  • Search Engine Optimization Manager

    1 week ago

    Udaipur, India Indian Institute of Organics Full time

    We are seeking a dynamic and results-driven SEO Manager to join our marketing team. The ideal candidate will have a deep understanding of search engine optimization strategies, a passion for data analysis, and a proven track record of improving organic search performance. You will be responsible for developing and implementing effective SEO strategies to...

  • Senior Staff Software Engineer

    2 months ago

    udaipur, India Coinbase Full time

    At Coinbase, our mission is to increase economic freedom around the world, and we couldn’t do this without hiring the best people. We’re a group of hard-working overachievers who are deeply focused on building the future of finance and Web3 for our users across the globe, whether they’re trading, storing, staking or using crypto. Know those people who...

  • Assistant Manager

    2 weeks ago

    Udaipur, India AccorHotel Full time

    Job DescriptionResponsibilities  To assist the chief engineer in the day to day work and oversee the preventive maintenance of all equipment.To assume all the responsibilities and authority of the chief engineer in his absence.To take regular training classes of Engineers and Staff.To check all log books daily and take corrective measures accordingly.To...

  • Traffic Engineer

    2 weeks ago

    Udaipur, India ITS Planners and Engineers Full time

    Company DescriptionITS Planners and Engineers (ITSPE) is a cutting-edge company specializing in Intelligent Transport Systems (ITS) located in Hyderabad. We provide consultancy services in Traffic Control and Management, Intelligent Transport Systems, and Traffic Engineering. Our innovative traffic control products empower road network managers to...

  • Assistant Manager Engineering

    6 months ago

    Udaipur, India Accor Full time

    Company Description Your Fairmont Journey Starts Here: Are you a someone with a passion for excellence and a flair for exceptional hospitality? Fairmont Udaipur Palace invites you to embark on an unforgettable journey of luxury and join our pre-opening team. Job Description Responsibilities To assist the chief engineer in the day-to-day work and...

  • Civil Engineering Project Manager

    1 month ago

    Udaipur, Rajasthan, India Lambsrock Full time

    Job Title: Project Manager - Civil EngineeringJob Summary:We are seeking a highly skilled and experienced Project Manager to lead our civil engineering projects. The successful candidate will have a strong background in project management, civil engineering principles, and practices.Key Responsibilities:Develop and execute comprehensive project plans,...