Data Engineering Azure databricks
2 days ago
Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Responsibilities: Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes. Create the data integration and data diagram documentation. Lead the data validation, UAT and regression test for new data asset creation. Create and maintain data models, including schema design and optimization. Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency. Qualifications and Skills: Strong knowledge on Python and Pyspark Expectation is to have ability to write Pyspark scripts for developing data workflows. Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum. Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks. Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows. Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing. Expectation is to have strong problem-solving and troubleshooting skills. Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes. Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience. 4-7 years of experience in Data Engineer. Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL. Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks. Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.
-
Data engineer | azure + databricks
2 weeks ago
Bangalore, India Xebia Full timeJob Opportunity – Data Engineer | Azure + Databricks Location: Bangalore (Whitefield) | Hybrid (3 days office/week) Experience: 6+ years Notice Period: Immediate to 2 weeks – only apply if you can join early About the Role: We are looking for a skilled Data Engineer to join our team, working on end-to-end data engineering and data...
-
Data Engineer | Azure + Databricks
2 weeks ago
Bangalore, India Xebia Full timeJob Opportunity – Data Engineer | Azure + Databricks Location: Bangalore (Whitefield) | Hybrid (3 days office/week) Experience: 6+ years Notice Period: Immediate to 2 weeks – only apply if you can join early About the Role: We are looking for a skilled Data Engineer to join our team, working on end-to-end data engineering and data science use cases . The...
-
Data Engineer – Databricks
2 weeks ago
bangalore, India Capgemini Engineering Full timeData Engineer – Databricks & PySparkLocation: BangaloreExperience: 6–9 yearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock the...
-
Data Engineer – Databricks
4 days ago
bangalore, India Capgemini Engineering Full timeData Engineer – Databricks & PySpark Location: Bangalore Experience: 6–9 years Choosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock...
-
Data Engineer | Azure + Databricks
2 weeks ago
bangalore, India Xebia Full time🔹 Job Opportunity – Data Engineer | Azure + Databricks 🔹Location: Bangalore (Whitefield) | Hybrid (3 days office/week)Experience: 6+ yearsNotice Period: Immediate to 2 weeks – only apply if you can join earlyAbout the Role:We are looking for a skilled Data Engineer to join our team, working on end-to-end data engineering and data science use cases....
-
Data Engineering Azure databricks
3 days ago
bangalore, India EXL Full timeData Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.Responsibilities:Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation.Lead...
-
Data Engineer
2 weeks ago
Bangalore, India Tata Consultancy Services Full timeDear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill - Data Engineer (Azure DataBricks, Pyspark) Exp range – 4 yrs – 6 yrs Location- Kolkata, Pune, Mumbai, Bangalore, Bhubaneshwar Notice period – 30-60 Pls find the Job Description below. - 5+ yrs. Development experience with Spark (PySpark), Python and SQL. - Extensive...
-
Data Engineer
2 weeks ago
bangalore, India Tata Consultancy Services Full timeDear Candidate Greetings from TATA Consultancy Services Job Openings at TCS Skill - Data Engineer ( Azure DataBricks, Pyspark) Exp range – 4 yrs – 6 yrs Location- Kolkata, Pune, Mumbai, Bangalore, Bhubaneshwar Notice period – 30-60 Pls find the Job Description below. 5+ yrs. Development experience with Spark (PySpark), Python and SQL. Extensive...
-
Azure Databricks Engineer
2 weeks ago
Bangalore, India Jobted IN C2 Full timeChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of...
-
Azure databricks, PySpark
2 weeks ago
bangalore, India Tata Consultancy Services Full timeRole: Azure Data Engineer(ADF, ADB)Required Technical Skill Set: Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQLExp : 4 to 6 YearLocation : Kolkata, Pune, Mumbai, Bangalore, BhubaneshwarMust-Have · Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse; establishing the cloud connectivity between...
