Databricks - data engineer
2 months ago
Experience: 5+ years
Should have good experience in databricks.
Role & Responsibilities Overview:
A seasoned data team member with a good grasp of both business and technical aspects. Familiarity with data stack
Interact with the other members of the data governance team,business teams to understand requirements and also collaborate with stewards / data custodians end users etc
Demonstrated experience of building efficient data pipelines using tools or technologies like Spark, Cloud native tools like EMR, Azure data factory, Informatica, Abinitio etc.
Understand the need for both batch and stream ingestion of the data from source databases like SQLServer, Oracle, My SQL etc. and build scripts logics for reusable data transformations.
Specialize in performance tuning of parked jobs, Databricks clusters and ETL processes leveraging advance features to enhance overall system efficiency.
Conduct code reviews to ensure adherence to best practices, coding standards within Databricks notebooks and scripts.
Lead Data Engineering Projects to manage and implement datadriven communication systems
Proficient in data engineering , data management principles
Good combination of technical skills, communication skills, and business acumen.
-
Data Engineer Databricks
3 weeks ago
Gurgaon, Haryana, India Truelancer Full timeJob Title: Data Engineer (Databricks)Experience: 4 - 8 YrsMandatory Skills: Pyspark, Azure, ADF, Databricks, ETL, SQLResponsibilities:Design and build efficient data pipelines using Spark-SQL and PySpark in Azure Databricks to drive business growth.Create scalable ETL processes using Azure Data Factory to ensure seamless data integration.Develop and maintain...
-
Data enginner
2 weeks ago
Gurgaon, India Truelancer.com Full timeJob Title: Data Engineer (Databricks) Experience: 4 - 8 Yrs Must-Have Skills: Pyspark, Azure, ADF, Databricks, ETL, SQL Responsibilities: Design and build data pipelines using Spark-SQL and Py Spark in Azure Databricks Design and build ETL pipelines using ADF Build and maintain a Lakehouse architecture in ADLS / Databricks. Perform data...
-
Data Enginner
2 weeks ago
Gurgaon, India Truelancer.com Full timeJob Title: Data Engineer (Databricks)Experience: 4 - 8 YrsMust-Have Skills: Pyspark, Azure, ADF, Databricks, ETL, SQLResponsibilities:Design and build data pipelines using Spark-SQL and PySpark in Azure DatabricksDesign and build ETL pipelines using ADFBuild and maintain a Lakehouse architecture in ADLS / Databricks.Perform data preparation tasks...
-
Data Enginner
2 weeks ago
Gurgaon, India Truelancer.com Full timeJob Title: Data Engineer (Databricks) Experience: 4 - 8 Yrs Must-Have Skills: Pyspark, Azure, ADF, Databricks, ETL, SQL Responsibilities: Design and build data pipelines using Spark-SQL and PySpark in Azure Databricks Design and build ETL pipelines using ADF Build and maintain a Lakehouse architecture in ADLS / Databricks. Perform data...
-
Data Engineering Professional
1 month ago
Gurgaon, Haryana, India Coforge Full timeCoforge seeks a seasoned Data Engineer to join its team in Gurugram, handling data engineering for data-driven initiatives.Key ResponsibilitiesData Pipeline Development: Design, develop, and maintain scalable data pipelines using Databricks and Azure Data Factory.Data Integration: Integrate data from various sources, ensuring data quality and...
-
Senior Data Engineer
5 days ago
Gurgaon/Gurugram, India Steerlean Consulting Services Pvt Ltd. Full timeJob Description : We are looking for a highly skilled Databricks PySpark Developer to join our data platform implementation team. In this role, you will be instrumental in designing, developing, and maintaining ETL processes to ensure efficient extraction, transformation, and loading of data from various sources into data lake and data warehouse.You will...
-
Azure Databricks Engineer
4 weeks ago
Gurgaon/Gurugram, India Arrixa Full timeKey Responsibilities :- Data Pipeline Development : Design, develop, and optimize data pipelines and workflows in Azure Databricks for ETL/ELT processing, data transformation, and analytics. - Big Data Solutions : Architect and implement big data solutions using Azure Databricks, Spark, Azure Data Lake, and other Azure data services. - Data Integration :...
-
Data Engineer
1 month ago
Gurgaon, India Collabera Digital Full timePosition Details:Job Title: Data EngineerExperience : 3+ yearsLocation: PuneJob Details and Requirements:What You’ll Bring:Programming/Scripting Languages : Proficiency in Python, SQL, and PySpark is required.Cloud Platforms : Experience with AWS or Azure , specifically in building data pipelines, is needed.Cloud-Based Data Platforms : Working knowledge...
-
Data engineer
1 month ago
Gurgaon, India Collabera Digital Full timePosition Details:Job Title: Data EngineerExperience : 3+ yearsLocation: PuneJob Details and Requirements:What You’ll Bring:Programming/Scripting Languages : Proficiency in Python, SQL, and Py Spark is required.Cloud Platforms : Experience with AWS or Azure , specifically in building data pipelines, is needed.Cloud-Based Data Platforms : Working...
-
Azure Data Engineer
5 days ago
Gurgaon, India RapidBrains Full timeJob Title: Azure Data EngineerExperience: 5-6 YearsLocation: GurgaonContract Duration: 6+ MonthsWork Time: IST ShiftJob DescriptionWe are seeking an Azure Data Engineer with expertise in Databricks to join our team. The ideal candidate will manage and optimize data pipelines, build scalable data solutions, and leverage Azure services and Databricks for...
-
Azure data engineer
3 days ago
Gurgaon, India RapidBrains Full timeJob Title: Azure Data EngineerExperience: 5-6 YearsLocation: GurgaonContract Duration: 6+ MonthsWork Time: IST ShiftJob DescriptionWe are seeking an Azure Data Engineer with expertise in Databricks to join our team. The ideal candidate will manage and optimize data pipelines, build scalable data solutions, and leverage Azure services and Databricks for...
-
AVP - Databricks solution Architect
3 days ago
Gurgaon, India Genpact Full timeInviting applications for the role of Assistant Vice President - DatabricksArchitect!In this role, the Databricks Architect is responsible for providing technical direction andlead a group of one or more developer to address a goal.Responsibilities• Architect and design solutions to meet functional and non-functional requirements.• Create and review...
-
Data Engineer for Scalable Data Pipelines
2 weeks ago
Gurgaon, Haryana, India Steerlean Consulting Services Pvt Ltd. Full timeJob DescriptionWe are seeking a highly skilled Data Engineer to join our team at Steerlean Consulting Services Pvt Ltd. The successful candidate will be responsible for designing, developing, and maintaining scalable data pipelines using Databricks PySpark.The ideal candidate will have experience with AWS Glue, Python/Pyspark, and cloud skills such as...
-
AVP - Databricks solution Architect
2 days ago
Gurgaon, India Genpact Full timeInviting applications for the role ofAssistant Vice President - DatabricksArchitect!In this role, theDatabricks Architectis responsible for providing technical direction andlead a group of one or more developer to address a goal.Responsibilities• Architect and design solutions to meet functional and non-functional requirements.• Create and review...
-
IICS & Databricks Data Operations Specialist
1 month ago
Gurgaon, Haryana, India Randstad Digital Full timeJob Title : Data Operations and Enhancements SpecialistExperience : 4-6 YearsLocation : Not SpecifiedRequirements : Strong expertise in Databricks, SQL, Python, and IICS to manage and enhance data management and reporting project. The ideal candidate will be responsible for running operations independently, performing ad-hoc analyses, and implementing...
-
Data Engineering Specialist
3 weeks ago
Gurgaon, Haryana, India Drimlite Full timeJob Title: Data Engineering Specialist\Helpers are needed to design, build, and maintain data pipelines. \\A strong background in PySpark, Databricks, and Azure DevOps is required.\\As a member of the global analytics team, you will collaborate with colleagues to ensure efficient data handling and gain insights that drive business decisions.\Key...
-
Senior Azure Data Engineer
2 months ago
Gurgaon/Gurugram, India Gallop Research Full timeRoles and Responsibilities : - Build ETL & data pipelines using Azure Data Factory & Databricks to help feed the data into data products/dashboards. - Automate processes and workflows to drive efficiencies for client. - Liaise with different stakeholders on ad-hoc analyses and monitor the entire DWH/Data Lake. - Working with stakeholders to gather...
-
Data Engineer
1 month ago
Gurgaon, India Collabera Digital Full timePosition Details: Job Title: Data Engineer Experience : 3+ years Location: Pune Job Details and Requirements: What You’ll Bring: Programming/Scripting Languages : Proficiency in Python, SQL, and PySpark is required. Cloud Platforms : Experience with AWS or Azure , specifically in building data pipelines, is needed. ...
-
Data Engineer
1 month ago
Gurgaon, India Collabera Digital Full timePosition Details:Job Title: Data EngineerExperience : 3+ yearsLocation: PuneJob Details and Requirements:What You’ll Bring:Programming/Scripting Languages : Proficiency inPython, SQL, and PySparkis required.Cloud Platforms : Experience with AWS orAzure , specifically in building data pipelines, is needed.Cloud-Based Data Platforms : Working knowledge...
-
Azure Data Engineer
3 days ago
Gurgaon, India RapidBrains Full timeJob Title: Azure Data EngineerExperience:5-6 YearsLocation:GurgaonContract Duration:6+ MonthsWork Time:IST ShiftJob DescriptionWe are seeking anAzure Data Engineerwith expertise in Databricks to join our team. The ideal candidate will manage and optimize data pipelines, build scalable data solutions, and leverage Azure services and Databricks for data...