Senior Data Engineer for Databricks and Data Lakes
2 weeks ago
Location: Bangalore
Experience: 8-11 years
Job Description:
- 9 to 12 years of experience in developing data lakes and data marts on Databricks, with expertise in ETL tools like Azure Data Factory, Informatica, and Spark.
- Develop and maintain ETL processes using Databricks notebooks, implement and optimize data pipelines for transformation and integration, and design Databricks data solutions (Delta Lake, data warehouse, data marts).
- Apply best practices in data modeling and ETL pipelines (streaming and batch), conduct stakeholder engagement, proof of concepts, and demos, and code review and Bitbucket merge management.
Key Responsibilities:
- Develop and implement data pipelines using Databricks, Spark, and Python.
- Design and maintain data lakes and data marts on Databricks, ensuring data quality and integrity.
- Collaborate with the team to develop and implement data governance policies and procedures.
- Stay up-to-date with the latest trends and technologies in data engineering and architecture.
-
Senior Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA Full timeJob Description Data Engineer - Cloud Solutions Diverse Data Engineering activities on Azure Data platform. Build & Deliver Data pipeline connecting various enterprise data sources. Develop data mappings to existing data sources. Design and develop big data processing notebooks using Azure Databricks. Scripting and programming using programming languages...
-
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleNTT DATA is seeking a Databricks Data Engineer to join our team in India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Key ResponsibilitiesDevelop and optimize Spark-based ETL jobs to process large datasets on Databricks.Design and implement data integration...
-
Databricks Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA Services Full timeDatabricks Data Engineer Job DescriptionJob Summary:We are seeking a skilled Databricks Data Engineer to join our team in Bangalore, India. The ideal candidate will have strong experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development.Main Responsibilities:Design, build, and maintain scalable...
-
Data Engineering Senior Specialist
1 week ago
Bengaluru, Karnataka, India NTT DATA Services Full timeData Engineering Senior Specialist RoleDiverse and dynamic Data Engineering activities on Azure Data platform. The role involves building and delivering Data pipelines connecting various enterprise data sources, both RDBMS and NoSQL. Develop data mappings to existing data sources and design big data processing notebooks using Azure Databricks. Scripting and...
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob DescriptionData Engineer - Diverse Data Engineering Activities on Azure Data PlatformMain Responsibilities:Design and develop big data processing notebooks using Azure DatabricksLead the data identification, data analysis efforts for data sources and work directly with data owner teamsDevelop data requirements for new data sourcesDesign and development...
-
Senior Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeAbout the RoleWe are seeking a highly skilled Senior Software Engineer to join our Data Platform team at Databricks. As a key member of our team, you will play a critical role in building the Data Intelligence Platform that will enable us to automate decision-making across the entire company.As a Senior Software Engineer, you will be responsible for...
-
Data Engineering Specialist
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the JobThis position requires a highly skilled Data Engineer to design, build, and maintain scalable data pipelines using Databricks on AWS. The ideal candidate will have strong experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development.Key ResponsibilitiesDesign, build, and maintain...
-
Senior Data Engineer
1 week ago
Bengaluru, Karnataka, India TE Connectivity Full timeData Engineer Role OverviewAt TE, we are looking for a Senior Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing data lakes, managing data flows that integrate information from various sources into a common data lake platform through an ETL Tool.Key ResponsibilitiesDesign and develop data lakes on AWS...
-
Data Engineer Lead
1 week ago
Bengaluru, Karnataka, India NTT DATA Services Full timeData Engineer LeadData Engineers within NTT DATA Services drive the creation of innovative data solutions that benefit our clients. As a Data Engineer Lead, you will be responsible for leading diverse data engineering activities on the Azure Data platform, including the development and delivery of data pipelines connecting various enterprise data sources,...
-
Senior Data Infrastructure Engineer
2 weeks ago
Bengaluru, Karnataka, India Databricks Full timeP-1348Databricks is revolutionizing the way data teams work. As a Senior Software Engineer on the Data Platform team, you will help build the Data Intelligence Platform that will automate decision-making across the entire company. You will collaborate with Databricks Product Teams, Data Science, and Applied AI to develop a variety of tools, including...
-
Senior Data Engineer
1 week ago
Bengaluru, Karnataka, India NR Consulting - India Full timeJob Title: Senior Data Engineer - Databricks Expert Location: Remote Experience: 5-11 years Job Description: - Must have: Databricks Python SQL Spark Jenkins Airflow Bitbucket - Nice to have: Python Understanding of ETL tools (Azure Data Factory, Informatica, etc.) Roles & Responsibilities: 3+ years of experience in developing data lakes and data marts...
-
Senior Data Engineer for Databricks and Python
2 weeks ago
Bengaluru, Karnataka, India Tata Consultancy Services Full timeOpportunity for Senior Data EngineersTata Consultancy Services is seeking experienced Senior Data Engineers to join our team.We are looking for professionals with extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage, and Python/PySpark.Key...
-
Senior Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeAbout the RoleWe are seeking a highly skilled Senior Software Engineer to join our Data Platform team at Databricks. As a key member of our team, you will play a critical role in building and operating our Data Intelligence Platform, which enables data-driven decision-making across the company.Key Responsibilities:Design and implement a scalable metrics...
-
Senior Data Engineer
4 weeks ago
Bengaluru, Karnataka, India Ahvi Infotech Full timeAbout the Job**Job Title:** Senior Data Engineer - Azure Databricks**Location:** Bengaluru, HyderabadWe are seeking a highly skilled Senior Data Engineer to lead our Azure Databricks team. The ideal candidate will have 8-13 years of IT experience and expertise in Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, and data warehouse.**Key...
-
Senior Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Databricks Full timeUnlock the Full Potential of Data Science and AnalyticsAt Databricks, we're committed to empowering businesses to make data-driven decisions. As a Solutions Engineer, you'll play a pivotal role in helping our customers unlock the full potential of data science and analytics. You'll work closely with our team to deliver customized solutions that drive...
-
Senior Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Altimetrik Full timeJob Title: Senior Data Engineer - Azure Databricks ExpertJob Description:As a Senior Data Engineer at Altimetrik, you will work on designing, developing, and maintaining large-scale data processing systems using Azure Databricks. Your primary responsibility will be to ensure the smooth functioning of our data analytics solutions, providing high-quality data...
-
Senior Data Engineer
3 weeks ago
Bengaluru, Karnataka, India Ahvi Infotech Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to lead our Azure Databricks team. The ideal candidate will have experience in building ETL/data warehouse transformation processes and direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).Key ResponsibilitiesExperience in building...
-
Staff Software Engineer
4 weeks ago
Bengaluru, Karnataka, India Databricks Full timeUnlock the Power of Data with DatabricksWe're passionate about empowering data teams to tackle the world's most complex challenges. Our cutting-edge data and AI infrastructure platform enables customers to harness deep data insights and drive business growth.As a Staff Software Engineer (Data Platform) at Databricks, you'll have the opportunity to work on a...
-
Senior Data Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout NTT DATANTT DATA is a $30+ billion global innovator of business and technology services. We help clients innovate, optimize, and transform for success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem. Our services include business and technology consulting, data and artificial intelligence,...
-
Data Engineer
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Services Full timeJob Title: Databricks Data EngineerJob Summary:We are seeking a highly skilled Databricks Data Engineer to join our team in Bangalore, India. The successful candidate will design, build, and maintain scalable data pipelines using Databricks on AWS.Key Responsibilities:Design and develop data pipelines using Databricks on AWS.Ingest data from multiple sources...