Data Engineer

3 weeks ago


BangalorePuneKolkataGurgaonGurugramChennai, IN VIDPRO CONSULTANCY SERVICES Full time

Mandatory Skills : Snowflake/Azure Data Factory/ PySpark / Databricks

Primary Roles and Responsibilities :

- Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF.

- Ability to provide solutions that are forward-thinking in data engineering and analytics space

- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

- Triage issues to find gaps in existing pipelines and fix the issues

- Work with business to understand the need in the reporting layer and develop a data model to fulfill reporting needs

- Help joiner team members to resolve issues and technical challenges.

- Drive technical discussions with client architect and team members

- Orchestrate the data pipelines in the scheduler via Airflow

Skills and Qualifications :

- Bachelor's and/or master's degree in computer science or equivalent experience.

- Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.

- Expertise in Snowflake security, Snowflake SQL and designing/implementing other Snowflake objects.

- Hands-on experience with Snowflake utilities, SnowSQL, Snowpipe, Snowsight and Snowflake connectors.

- Deep understanding of Star and Snowflake dimensional modeling.

- Strong knowledge of Data Management principles

- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

- Should have hands-on experience in SQL and Spark (PySpark)

- Experience in building ETL / data warehouse transformation processes

- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

- Experience working with structured and unstructured data including imaging & geospatial data.

- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning, troubleshooting and Query Optimization.

- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

- Should have experience working in Agile methodology

- Strong verbal and written communication skills.

- Strong analytical and problem-solving skills with a high attention to detail.

(ref:hirist.tech)
  • Azure Data Engineer

    2 weeks ago


    Bangalore/Pune/Kolkata/Chennai/Gurgaon/Gurugram, IN VIDPRO CONSULTANCY SERVICES Full time

    Primary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix the...


  • Gurgaon/Gurugram, IN OFB Tech Pvt Ltd Full time

    We are currently seeking a talented and motivated Data Engineer to join our dynamic team and play a crucial role in shaping the future of our data : - Design, develop, and maintain robust data pipelines for efficient and scalable data processing.- Implement data integration solutions using Python and Java programming languages.- Utilize Airflow for...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram/Bangalore, IN Huquo Full time

    Role and Responsibilities :- To work on Data Governance - Build a robust data quality validation framework, business rules to identify any data quality issues.- Liaise with different client stakeholders on ad-hoc analyses related to monitoring the data- Build ETL & data pipelines to help feed the data into different business facing data products /...

  • Data Engineer

    2 weeks ago


    Bangalore/Gurgaon/Gurugram, IN Intuitive Apps Full time

    Key Skills : Minimum 6 years Exp in Data Engineer , 3yrs in Azure Data Factory, Pyspark, DatabricksJob Description :- Create and maintain optimal data pipeline architecture- Knowledge on Data Modelling, Data warehouse, and Data Analysis is also required.- Design and develop Data Warehouse solutions- Assemble large, complex data sets that meet functional /...


  • Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description :Role Overview :We are looking for a go-getter person who can define :- Data strategies to meet the demands of business requirements- Technical requirements of the organizational data needs from diverse teams- Data architecture, models and go-forward data solutions for various teams of the organization- The person will be part of the Data...

  • Data Engineer

    7 days ago


    Bangalore/Pune/Kolkata/Gurgaon/Gurugram/Mumbai/Ahmedabad, IN Sterlite Technologies Limited Full time

    Role as a Data engineer :- Develop and build AI/ML model ready data ponds using Azure Databricks Delta lake- Improve upon the data ingestion models, ETL jobs, and alarm to maintain data integrity and data availability.- Partner with AI/ML product teams proactively identify the data needs for rapid experimentation, stable production deployment and ensure the...

  • Manager/Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description :The Data Engineering Team primarily work with the lead data engineer, product owners, architects, engineering teams and BI developers to implement and drive forward data & analytics goals within Risk.This is an opportunity to work as a "hands on" data engineer, engaging with a variety of stakeholders in engineering teams and the business to...

  • Data Engineer

    1 week ago


    Gurgaon/Gurugram, IN Upnotch Consulting Full time

    Position Summary :In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights. Your Role Responsibilities and Duties : - Monitor and troubleshoot operational or data issues...


  • Gurgaon/Gurugram, IN Bigfoot Retail Solutions Pvt. Ltd Full time

    Job Description :- Design and build data pipelines from various cloud data sources for the enterprise data warehouse- Partner with Data Engineers, Data architects, domain experts, data analysts and other teams to build foundational data sets that are trusted, well understood, aligned with business strategy and enable self-service- Own and document data...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN True Tech Professionals Private Limited Full time

    Location : Gurgaon (Hybrid Mode)Experience : 5 years and above. (Less than 5 years will not be considered)Immediate Joiners Preferred (Notice Period: 7 to 10 days)We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena,...

  • Azure Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN Conneqtcorp Full time

    Role - Azure Data EngineerLocation - GurugramWork Mode - HybridSkills - Databricks, Azure, Python, SQLNotice Period - May JoinersRole Overview :We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for maintaining and optimizing data pipelines, implementing robust data checks, and ensuring the accuracy and...

  • Data Engineer

    3 weeks ago


    Pune/Gurgaon/Gurugram, IN Huquo Full time

    Position : Snowflake DELocation : Pune, GurgaonExperience : 6-9 YearsClairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram/Bangalore, IN Huquo Full time

    Role and Responsibilities :- Liaise with different client stakeholders on ad-hoc analyses related to monitoring the entire data lake- Build ETL & data pipelines to help feed the data into different business facing data products/dashboards- Explore options to automate processes & workflows and thus drive efficiencies for client- Work on ML Model based...


  • Gurgaon/Gurugram, IN Paisabazaar.com Full time

    Job Description :Qualifications for Data Engineer :3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.Strong analytic skills to understand and...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble large, complex data sets that meet functional / non-functional business requirements- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN True Tech Professionals Private Limited Full time

    Data Engineer - SnowflakeLocation : Gurgaon (Hybrid)Summary :We are seeking a skilled Data Engineer with expertise in Snowflake to join our dynamic team. The ideal candidate will have a solid understanding of data governance principles and extensive experience in developing governance dashboards using Snowflake, Snowpark, Snowflake stored procedures, and...

  • Publicis Sapient

    3 weeks ago


    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...


  • Gurgaon/Gurugram, IN CASHGRAIL PRIVATE LIMITED Full time

    Role & Responsibilities (KRAs) 1) Understand, implement and automate ETL and data pipelines with up-to-date industry standards 2) Hands-on involvement in the design, development and implementation of optimal and scalable data systems 3) Design, build and scale data projects independently and mentor junior data engineers Must - Have Skills: 1) Data Structure...

  • Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    MIS team is seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance/expand team capabilities. They will work on analyzing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms and analytics. Google Cloud Data Engineers will be responsible for designing...