
Azure Data Bricks
2 weeks ago
**Role Overview**:
As a Data Engineer specializing in Databricks and AWS Glue, you will play a key role in designing, developing, and maintaining data pipelines and analytics solutions for our clients. You will collaborate with cross-functional teams to understand business requirements, architect scalable solutions, and ensure data reliability and performance.
**Responsibilities**:
- Design, build, and optimize data pipelines using Databricks and AWS Glue to ingest, transform, and load large volumes of data from various sources.
- Work closely with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
- Develop ETL workflows and data processing jobs to cleanse, aggregate, and enrich data for downstream analytics and reporting.
- Implement best practices for data governance, security, and compliance, ensuring data quality and integrity throughout the pipeline.
- Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner, optimizing performance and resource utilization.
- Collaborate with cloud architects to optimize infrastructure and resource provisioning for Databricks and AWS Glue environments.
- Stay up-to-date with the latest advancements in big data technologies and best practices, continuously improving our data engineering processes and toolsets.
**Qualifications**:
- Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
- 3+ years of experience in data engineering or related roles, with a focus on building scalable data pipelines.
- Hands-on experience with Databricks and AWS Glue, including proficiency in Spark-based data processing and orchestration.
- Strong programming skills in Python, Scala, or Java, with a solid understanding of software development principles and best practices.
- Experience with cloud platforms such as AWS, Azure, or GCP, including knowledge of core services and infrastructure management.
- Familiarity with data modeling concepts, database systems, and SQL query optimization.
- Excellent problem-solving and analytical skills, with a strong attention to detail and commitment to delivering high-quality solutions.
- Ability to work independently and collaboratively in a fast-paced environment, with a passion for learning and continuous improvement.
**Good to Have**:
- Certification in Databricks or AWS related technologies.
- Experience with other big data tools and frameworks such as Apache Kafka, Apache Hadoop, or Apache Flink.
- Knowledge of machine learning concepts and libraries for advanced analytics and AI.
- Previous experience working with data visualization tools such as Tableau, Power BI, or Looker.
- Contributions to open-source projects or active participation in developer communities.
**Experience: 1-3 Years**
**Location: Mumbai**
**Job Types**: Full-time, Permanent
Pay: ₹8,874.00 - ₹45,599.09 per month
**Benefits**:
- Health insurance
- Provident Fund
Schedule:
- Day shift
- Monday to Friday
**Experience**:
- Azure Data Bricks: 1 year (required)
Work Location: In person
-
Azure Data Bricks
4 weeks ago
Mumbai, India ENORMOUS IT PVT LTD Full timeAzure Data Factory: - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data components such as Kafka, Spark SQL,...
-
Azure Data Bricks Ai
3 weeks ago
Pune, Maharashtra, India Virtusa Full timeDescription - External Key Job Functions Develop, test, and implement robust and innovative AI models in Azure Data bricks Leverage Azure Data bricks to solve diverse and complex business problems. Collaborate with data scientists to build high performing algorithms Data Services, Python, Scala, Spark Continually monitor the latest advancements in AI...
-
Azure Data Bricks
4 weeks ago
Mumbai, India Capgemini Full timeExperience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics - Experience in Python/ Pyspark Programming. - Experience with Azure Databricks/ADB - Experience with building CI/CD pipelines in Data environments **Primary Skills**: - Azure Data Bricks (ADB) - Python,...
-
Data Engineer
21 hours ago
Chennai, Bengaluru, Mumbai, India Gsparks Technology Services Private Limited Full timeJob Description Job Title: Junior Data Engineer (Data bricks & Azure) Experience: 3-5 years The Opportunity We are looking for a skilled and motivated Data Engineer with 3-5 years of experience in Databricks and Azure to join our team. In this role, you will be responsible for designing, developing, and maintaining scalable data pipelines and data lake...
-
▷ 15h Left: Data Engineer
1 week ago
Mumbai, Pune, India Capgemini Technology Services India Limited Full timeJob Description Job Title : Azure Databricks Location : Bangalore,Hyderbad,Mumbai,Pune,chennai,Gurugram,Noida,Delhi,Kolkatta,PAN India Experience : 5.5 years to 13 years Skills : Azure Databricks Job Description : - Experience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse,...
-
▷ (Immediate Start) Azure Databricks
1 week ago
Mumbai, Pune, India Capgemini Technology Services India Limited Full timeJob Description Job Title :Azure Databricks Location : Bangalore,Hyderbad,Mumbai,Pune,chennai,Gurugram,Noida,Delhi,Kolkatta,CG Offices PAN India Experience : 5.5 years to 13 years Skills : Azure Databricks Job Description : - Experience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL...
-
Azure Sme
3 weeks ago
Pune, Maharashtra, India HoonarTek Full timePune*** **About Us** - We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization. - Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner. - Using centuries of cumulative experience, research and...
-
Azure Data Architect with Synapse Expert
7 days ago
Mumbai, Pune, India LTIMindtree Limited Full timeAt LTIMindtree Limited, we are on the lookout for a seasoned Azure Data Architect with Synapse Expert to join our team. This role involves working with various data technologies, including Azure Data Factory, Databricks, and Azure Synapse Analytics.The ideal candidate should have a strong understanding of SQL and complex queries, as well as experience in...
-
Azure Data Bricks, Data Factory, Data Lake
4 weeks ago
Mumbai, Maharashtra, India ScatterPie Analytics Full time**Job Title**: ETL+ SQL Developer Skills: ETL+ SQL - Experience with SQL and data querying languages. - Knowledge of data governance frameworks and best practices. - Familiarity with programming/scripting languages (e.g., SparkSQL) - Strong understanding of data integration techniques and ETL processes. - Experience with data quality tools and...
-
Azure Data Bricks with Pyspark
2 weeks ago
Chennai, Bengaluru, Mumbai, India ********** Full timeJob Description Overall 6-9 yrs of IT experience preferably in cloud - Min 5 years in Azure Databricks on development projects - Should be 100% hands on in Pyspark coding - Should have strong SQL expertise in writing advanced/complex SQL queries - DWH experienceis a must for this role - Experience in programming using Python is an advantage - Experience in...
-
Azure Data Engineer
2 weeks ago
Mumbai, India People Konnect Full timeJob Title : Data EngineerFunction : Information TechnologyLocation : Mumbai, Maharashtra, IndiaEducation : - BE / B-Tech in Computer Science from a premier institute- MBA is preferred- Azure Cloud Data Engineering CertificationsExperience: - 10 years of overall exp and at least 5 years exp in Azure Data EngineeringResponsibility :- Designing and implementing...
-
Hiring for Azure Data Engineer
3 weeks ago
Mumbai, India Tata Consultancy Services Full timeDear Tech Professional Greetings from Tata Consultancy Services TCS has always been in the spotlight for being adept in “the next big technologies”. What we can offer you is a space to explore varied technologies and quench your techie soul. What we are looking for: Azure Data Engineer Years of exp: 4-14 Years Interview Location: Mumbai / Pune Job...
-
Cloud Data Architect
7 days ago
Mumbai, Maharashtra, India Tata Consultancy Services Full timeTata Consultancy Services is seeking a skilled Cloud Data Architect to join our team.The ideal candidate will have extensive experience designing and implementing large-scale data processing systems on Azure. You should possess a deep understanding of Azure services such as Azure Data Factory, Azure Data Bricks, and Azure Streaming Analytics.As a Cloud Data...
-
Hiring for Azure Data Engineer
4 weeks ago
Mumbai, India Tata Consultancy Services Full timeDear Tech ProfessionalGreetings from Tata Consultancy ServicesTCS has always been in the spotlight for being adept in “the next big technologies”. What we can offer you is a space to explore varied technologies and quench your techie soul.What we are looking for: Azure Data EngineerYears of exp: 4-14 YearsInterview Location: Mumbai / PuneJob...
-
Data Engineering Lead
7 days ago
Mumbai, Maharashtra, India Tata Consultancy Services Full timeAbout this role:This is a unique opportunity to join Tata Consultancy Services as a Data Engineering Lead. As a leader, you will be responsible for driving the company's data engineering strategy and ensuring the successful delivery of data projects.You will lead a team of data engineers and architects to design, build, and maintain large-scale data...
-
Azure Senior Cloud Architect
3 days ago
Mumbai, Maharashtra, India CloudFronts - Microsoft Solutions Partner Full timeJob Summary: We are looking for a highly skilled Sr. Azure developer/architect to help us deliver high-quality cloud-based solutions for our clients.The ideal candidate will have hands-on experience with Data Bricks, Azure Functions, Azure APIM, Azure Service Bus, Azure Storage Account, Azure Logic App, and CI/CD pipelines using Azure DevOps.Main...
-
Senior Data Engineer
7 days ago
Mumbai, Maharashtra, India Tata Consultancy Services Full timeAbout the Role:As a Senior Data Engineer at Tata Consultancy Services, you will play a pivotal role in designing, building, and maintaining large-scale data processing systems on Azure. Your expertise in Azure services such as Azure Data Factory, Azure Data Bricks, and Azure Streaming Analytics will be instrumental in shaping our data engineering strategy.We...
-
Data Engineer
3 days ago
Mumbai, India Tata Consultancy Services Full timeUnleash innovation with cloud at TCS !!!Join the Virtual Drive on 1st-Feb-2025 and Pave your path to value with TCS AI Cloud TeamInterview Mode : Virtual/ OnlineROLE- Azure Data EngineerExperience range is 5-8 years,*(min 5 yrs of relevant exp needed)Placement Location - Bangalore/Mumbai/ChennaiSkills required- Azure Developer, Azure data Bricks, Azure Fata...
-
Data Engineer
3 days ago
Mumbai, India Tata Consultancy Services Full timeUnleash innovation with cloud at TCS !!!Join the Virtual Drive on 1st-Feb-2025 and Pave your path to value with TCS AI Cloud TeamInterview Mode : Virtual/ OnlineROLE- Azure Data EngineerExperience range is 5-8 years,*(min 5 yrs of relevant exp needed)Placement Location - Bangalore/Mumbai/ChennaiSkills required- Azure Developer, Azure data Bricks, Azure Fata...
-
Hiring for Azure Data Engineer
4 weeks ago
Mumbai, India Tata Consultancy Services Full timeDear Tech ProfessionalGreetings from Tata Consultancy ServicesTCS has always been in the spotlight for being adept in “the next big technologies”. What we can offer you is a space to explore varied technologies and quench your techie soul.What we are looking for: Azure Data EngineerYears of exp: 4-14 YearsInterview Location: Mumbai / PuneJob...