Data Engineer

1 month ago

Gurgaon, India Collabera Digital Full time
Position Details:

Job Title: Data EngineerExperience : 3+ yearsLocation: Pune

Job Details and Requirements:

What You’ll Bring:Programming/Scripting Languages : Proficiency in

Python, SQL, and PySpark

is required.Cloud Platforms : Experience with AWS or

Azure , specifically in building data pipelines, is needed.Cloud-Based Data Platforms : Working knowledge of

Snowflake and Databricks

is preferred.Data Pipeline Orchestration : Experience with Azure Data Factory and AWS Glue for orchestrating data pipelines is necessary.Relational Databases : Competency with relational databases such as PostgreSQL and MySQL is required, while experience with NoSQL databases is a plus.BI Tools : Knowledge of BI tools such as Tableau and PowerBI is expected.CI/CD for Data Pipelines : Experience in implementing continuous integration and delivery for data workflows using tools like Azure DevOps is essential.

Big Data Technologies : Proficiency in working with big data technologies, particularly in the context of Azure Databricks, which may include Apache Spark for distributed data processing.Azure Databricks : In-depth knowledge of Azure Databricks for data engineering tasks, including data transformations, ETL processes, and job scheduling.SQL and Query Optimization: Strong SQL skills for data manipulation and retrieval, along with the ability to optimize queries for performance in Snowflake.ETL (Extract, Transform, Load):

Expertise in designing and implementing ETL processes to move and transform data between systems, utilizing tools and frameworks available in Azure Databricks.Data Integration : Experience with integrating diverse data sources into a cohesive and usable format, ensuring data quality and integrity.Python/PySpark : Knowledge of programming languages like Python and PySpark for scripting and extending the functionality of Azure Databricks notebooks.Version Control : Familiarity with version control systems, such as Git, for managing code and configurations in a collaborative environment.Monitoring and Optimization : Ability to monitor data pipelines, identify bottlenecks, and optimize performance for both Azure Data FactorySecurity and Compliance : Understanding of security best practices and compliance considerations when working with sensitive data in Azure and Snowflake environments.Snowflake Data Warehouse : Experience in designing, implementing, and optimizing data warehouses using Snowflake, including schema design, performance tuning, and query optimization.Healthcare Domain Knowledge : Familiarity with US health plan terminologies and datasets is essential.

  • Data engineer/senior data engineer

    1 month ago

    Gurgaon, India Cognitio Analytics Inc Full time

    Experience:1 to 8 years - DE/ Sr. DE/ AM /ManagerMust Have:SQLPython/ PysparkAzure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, Bit Bucket, Version control, Azure Dev OpsETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data SecurityAgile Practices, SDLCData Exploration, Data Quality metrics, Historical data Management, Good...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Talentpro Edge Full time

    Key ResponsibilitiesAs a Data Engineer at Talentpro Edge, you will be responsible for exploring and acquiring new sources of data. This involves using technology to automate data acquisition and linking new sources with internal data.Ensuring Data QualityEnsure the quality and understanding of analytical data by investigating data issues and seeking...

  • Data Engineer

    3 months ago

    Gurgaon, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data engineer

    4 weeks ago

    Gurgaon, India Aays Full time

    Position : Senior Data Engineer / Data Engineer Desired Experience : 3+ years You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a...

  • Data engineer

    3 weeks ago

    Gurgaon, India Straive Full time

    Job Title: Data Engineer Location: Hyderabad/Bangalore/Gurgaon Job Type: Full time Years of Experience- 6-11 years About Straive: Straive is a market leading Content and Data Technology company providing data services, subject matter expertise, & technology solutions to multiple domains. Data Analytics & Al Solutions, Data Al Powered...

  • Data engineer

    1 month ago

    Gurgaon, India Aays Full time

    Position : Senior Data Engineer / Data EngineerDesired Experience : 3+ yearsYou will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a...

  • Data Engineer

    1 month ago

    Gurgaon, India Aays Full time

    Position : Senior Data Engineer / Data EngineerDesired Experience : 3+ yearsYou will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a...

  • Data Engineer

    6 months ago

    Gurgaon, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...

  • Data engineer

    2 months ago

    Gurgaon, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, My SQL, and technologies like...

  • Data Engineer

    3 weeks ago

    Gurgaon, India Straive Full time

    Job Title: Data EngineerLocation: Hyderabad/Bangalore/GurgaonJob Type: Full timeYears of Experience- 6-11 yearsAbout Straive:Straive is a market leading Content and Data Technology company providing data services, subject matter expertise, & technology solutions to multiple domains.Data Analytics & Al Solutions, Data Al Powered Operations and Education &...

  • Data Engineer

    2 months ago

    Gurgaon, India IGT Solutions Full time

    Job Overview:Data Engineer(Immediate Joiners Preferred)Exp:7+ YearsThe Data Engineer will work closely with other members of the data team to ensure data is properly ingested, cleaned, and stored for future analysis. He/she will take requirements from the reporting & business analysis team (product owner and reporting specialists) and create the appropriate...

  • Data engineer

    4 weeks ago

    Gurgaon, India Material Full time

    Role :- AWS Data EngineerLocation :- Gurgaon / BangaloreNotice :- Immediate Joiners OnlySkills:- AWS , Spark , Python , Glue , S3 , Redshift etc..Experience:- 4+ YearsPosition Overview:We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with AWS Glue, Apache Airflow, Kafka,...

  • Data engineer

    2 months ago

    Gurgaon, India IGT Solutions Full time

    Job Overview: Data Engineer(Immediate Joiners Preferred) Exp:7+ Years The Data Engineer will work closely with other members of the data team to ensure data is properly ingested, cleaned, and stored for future analysis. He/she will take requirements from the reporting & business analysis team (product owner and reporting specialists) and create the...

  • Data Engineer

    3 weeks ago

    Gurgaon, India Straive Full time

    Job Title: Data Engineer Location: Hyderabad/Bangalore/Gurgaon Job Type: Full time Years of Experience- 6-11 years About Straive: Straive is a market leading Content and Data Technology company providing data services, subject matter expertise, & technology solutions to multiple domains. Data Analytics & Al Solutions, Data Al Powered...

  • Data engineer

    2 months ago

    Gurgaon, India IGT Solutions Full time

    Job Overview:Data Engineer(Immediate Joiners Preferred)Exp:7+ YearsThe Data Engineer will work closely with other members of the data team to ensure data is properly ingested, cleaned, and stored for future analysis. He/she will take requirements from the reporting & business analysis team (product owner and reporting specialists) and create the appropriate...

  • Data Engineer

    3 months ago

    Gurgaon, India Nutrabay Full time

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like...

  • Data Engineer

    3 weeks ago

    Gurgaon, India Undisclosed Full time

    LocationThe successful candidate shall be placed at any of our Client's location in Gurugram, Haryana. It is a Full-time Job, “No” remote work. Data Engineers willing to work full-time inPython/PySparkand have deep knowledge ofETL tools, Large DatabasesandSQLmay apply.Key ResponsibilitiesDesign, build, and maintain scalable data pipelines using Python...

  • Data engineer

    3 weeks ago

    Gurgaon, India Undisclosed Full time

    Location The successful candidate shall be placed at any of our Client's location in Gurugram, Haryana. It is a Full-time Job, “No” remote work. Data Engineers willing to work full-time in Python/Py Spark and have deep knowledge of ETL tools, Large Databases and SQL may apply. Key Responsibilities Design, build, and maintain...

  • Data Engineer

    1 month ago

    Gurgaon, India IGT Solutions Full time

    Job Overview: Data Engineer(Immediate Joiners Preferred) Exp:7+ Years The Data Engineer will work closely with other members of the data team to ensure data is properly ingested, cleaned, and stored for future analysis. He/she will take requirements from the reporting & business analysis team (product owner and reporting specialists) and create the...

  • Data Engineer

    3 weeks ago

    Gurgaon, India Undisclosed Full time

    LocationThe successful candidate shall be placed at any of our Client's location in Gurugram, Haryana. It is a Full-time Job, “No” remote work. Data Engineers willing to work full-time in Python/PySpark and have deep knowledge of ETL tools, Large Databases and SQL may apply.Key ResponsibilitiesDesign, build, and maintain scalable data pipelines...