Azure Data Bricks

2 weeks ago


Mumbai Maharashtra, India ScatterPie Analytics Full time

**Role Overview**:
As a Data Engineer specializing in Databricks and AWS Glue, you will play a key role in designing, developing, and maintaining data pipelines and analytics solutions for our clients. You will collaborate with cross-functional teams to understand business requirements, architect scalable solutions, and ensure data reliability and performance.

**Responsibilities**:

- Design, build, and optimize data pipelines using Databricks and AWS Glue to ingest, transform, and load large volumes of data from various sources.
- Work closely with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
- Develop ETL workflows and data processing jobs to cleanse, aggregate, and enrich data for downstream analytics and reporting.
- Implement best practices for data governance, security, and compliance, ensuring data quality and integrity throughout the pipeline.
- Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner, optimizing performance and resource utilization.
- Collaborate with cloud architects to optimize infrastructure and resource provisioning for Databricks and AWS Glue environments.
- Stay up-to-date with the latest advancements in big data technologies and best practices, continuously improving our data engineering processes and toolsets.

**Qualifications**:

- Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
- 3+ years of experience in data engineering or related roles, with a focus on building scalable data pipelines.
- Hands-on experience with Databricks and AWS Glue, including proficiency in Spark-based data processing and orchestration.
- Strong programming skills in Python, Scala, or Java, with a solid understanding of software development principles and best practices.
- Experience with cloud platforms such as AWS, Azure, or GCP, including knowledge of core services and infrastructure management.
- Familiarity with data modeling concepts, database systems, and SQL query optimization.
- Excellent problem-solving and analytical skills, with a strong attention to detail and commitment to delivering high-quality solutions.
- Ability to work independently and collaboratively in a fast-paced environment, with a passion for learning and continuous improvement.

**Good to Have**:

- Certification in Databricks or AWS related technologies.
- Experience with other big data tools and frameworks such as Apache Kafka, Apache Hadoop, or Apache Flink.
- Knowledge of machine learning concepts and libraries for advanced analytics and AI.
- Previous experience working with data visualization tools such as Tableau, Power BI, or Looker.
- Contributions to open-source projects or active participation in developer communities.

**Experience: 1-3 Years**

**Location: Mumbai**

**Job Types**: Full-time, Permanent

Pay: ₹8,874.00 - ₹45,599.09 per month

**Benefits**:

- Health insurance
- Provident Fund

Schedule:

- Day shift
- Monday to Friday

**Experience**:

- Azure Data Bricks: 1 year (required)

Work Location: In person


  • Azure Data Bricks

    4 weeks ago


    Mumbai, India ENORMOUS IT PVT LTD Full time

    Azure Data Factory: - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data components such as Kafka, Spark SQL,...

  • Azure Data Bricks Ai

    3 weeks ago


    Pune, Maharashtra, India Virtusa Full time

    Description - External Key Job Functions Develop, test, and implement robust and innovative AI models in Azure Data bricks Leverage Azure Data bricks to solve diverse and complex business problems. Collaborate with data scientists to build high performing algorithms Data Services, Python, Scala, Spark Continually monitor the latest advancements in AI...

  • Azure Data Bricks

    4 weeks ago


    Mumbai, India Capgemini Full time

    Experience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics - Experience in Python/ Pyspark Programming. - Experience with Azure Databricks/ADB - Experience with building CI/CD pipelines in Data environments **Primary Skills**: - Azure Data Bricks (ADB) - Python,...

  • Data Engineer

    21 hours ago


    Chennai, Bengaluru, Mumbai, India Gsparks Technology Services Private Limited Full time

    Job Description Job Title: Junior Data Engineer (Data bricks & Azure) Experience: 3-5 years The Opportunity We are looking for a skilled and motivated Data Engineer with 3-5 years of experience in Databricks and Azure to join our team. In this role, you will be responsible for designing, developing, and maintaining scalable data pipelines and data lake...


  • Mumbai, Pune, India Capgemini Technology Services India Limited Full time

    Job Description Job Title : Azure Databricks Location : Bangalore,Hyderbad,Mumbai,Pune,chennai,Gurugram,Noida,Delhi,Kolkatta,PAN India Experience : 5.5 years to 13 years Skills : Azure Databricks Job Description : - Experience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse,...


  • Mumbai, Pune, India Capgemini Technology Services India Limited Full time

    Job Description Job Title :Azure Databricks Location : Bangalore,Hyderbad,Mumbai,Pune,chennai,Gurugram,Noida,Delhi,Kolkatta,CG Offices PAN India Experience : 5.5 years to 13 years Skills : Azure Databricks Job Description : - Experience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL...

  • Azure Sme

    3 weeks ago


    Pune, Maharashtra, India HoonarTek Full time

    Pune*** **About Us** - We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization. - Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner. - Using centuries of cumulative experience, research and...


  • Mumbai, Pune, India LTIMindtree Limited Full time

    At LTIMindtree Limited, we are on the lookout for a seasoned Azure Data Architect with Synapse Expert to join our team. This role involves working with various data technologies, including Azure Data Factory, Databricks, and Azure Synapse Analytics.The ideal candidate should have a strong understanding of SQL and complex queries, as well as experience in...


  • Mumbai, Maharashtra, India ScatterPie Analytics Full time

    **Job Title**: ETL+ SQL Developer Skills: ETL+ SQL - Experience with SQL and data querying languages. - Knowledge of data governance frameworks and best practices. - Familiarity with programming/scripting languages (e.g., SparkSQL) - Strong understanding of data integration techniques and ETL processes. - Experience with data quality tools and...


  • Chennai, Bengaluru, Mumbai, India ********** Full time

    Job Description Overall 6-9 yrs of IT experience preferably in cloud - Min 5 years in Azure Databricks on development projects - Should be 100% hands on in Pyspark coding - Should have strong SQL expertise in writing advanced/complex SQL queries - DWH experienceis a must for this role - Experience in programming using Python is an advantage - Experience in...

  • Azure Data Engineer

    2 weeks ago


    Mumbai, India People Konnect Full time

    Job Title : Data EngineerFunction : Information TechnologyLocation : Mumbai, Maharashtra, IndiaEducation : - BE / B-Tech in Computer Science from a premier institute- MBA is preferred- Azure Cloud Data Engineering CertificationsExperience: - 10 years of overall exp and at least 5 years exp in Azure Data EngineeringResponsibility :- Designing and implementing...


  • Mumbai, India Tata Consultancy Services Full time

    Dear Tech Professional Greetings from Tata Consultancy Services TCS has always been in the spotlight for being adept in “the next big technologies”. What we can offer you is a space to explore varied technologies and quench your techie soul. What we are looking for: Azure Data Engineer Years of exp: 4-14 Years Interview Location: Mumbai / Pune Job...


  • Mumbai, Maharashtra, India Tata Consultancy Services Full time

    Tata Consultancy Services is seeking a skilled Cloud Data Architect to join our team.The ideal candidate will have extensive experience designing and implementing large-scale data processing systems on Azure. You should possess a deep understanding of Azure services such as Azure Data Factory, Azure Data Bricks, and Azure Streaming Analytics.As a Cloud Data...


  • Mumbai, India Tata Consultancy Services Full time

    Dear Tech ProfessionalGreetings from Tata Consultancy ServicesTCS has always been in the spotlight for being adept in “the next big technologies”. What we can offer you is a space to explore varied technologies and quench your techie soul.What we are looking for: Azure Data EngineerYears of exp: 4-14 YearsInterview Location: Mumbai / PuneJob...


  • Mumbai, Maharashtra, India Tata Consultancy Services Full time

    About this role:This is a unique opportunity to join Tata Consultancy Services as a Data Engineering Lead. As a leader, you will be responsible for driving the company's data engineering strategy and ensuring the successful delivery of data projects.You will lead a team of data engineers and architects to design, build, and maintain large-scale data...


  • Mumbai, Maharashtra, India CloudFronts - Microsoft Solutions Partner Full time

    Job Summary: We are looking for a highly skilled Sr. Azure developer/architect to help us deliver high-quality cloud-based solutions for our clients.The ideal candidate will have hands-on experience with Data Bricks, Azure Functions, Azure APIM, Azure Service Bus, Azure Storage Account, Azure Logic App, and CI/CD pipelines using Azure DevOps.Main...


  • Mumbai, Maharashtra, India Tata Consultancy Services Full time

    About the Role:As a Senior Data Engineer at Tata Consultancy Services, you will play a pivotal role in designing, building, and maintaining large-scale data processing systems on Azure. Your expertise in Azure services such as Azure Data Factory, Azure Data Bricks, and Azure Streaming Analytics will be instrumental in shaping our data engineering strategy.We...

  • Data Engineer

    3 days ago


    Mumbai, India Tata Consultancy Services Full time

    Unleash innovation with cloud at TCS !!!Join the Virtual Drive on 1st-Feb-2025 and Pave your path to value with TCS AI Cloud TeamInterview Mode : Virtual/ OnlineROLE- Azure Data EngineerExperience range is 5-8 years,*(min 5 yrs of relevant exp needed)Placement Location - Bangalore/Mumbai/ChennaiSkills required- Azure Developer, Azure data Bricks, Azure Fata...

  • Data Engineer

    3 days ago


    Mumbai, India Tata Consultancy Services Full time

    Unleash innovation with cloud at TCS !!!Join the Virtual Drive on 1st-Feb-2025 and Pave your path to value with TCS AI Cloud TeamInterview Mode : Virtual/ OnlineROLE- Azure Data EngineerExperience range is 5-8 years,*(min 5 yrs of relevant exp needed)Placement Location - Bangalore/Mumbai/ChennaiSkills required- Azure Developer, Azure data Bricks, Azure Fata...


  • Mumbai, India Tata Consultancy Services Full time

    Dear Tech ProfessionalGreetings from Tata Consultancy ServicesTCS has always been in the spotlight for being adept in “the next big technologies”. What we can offer you is a space to explore varied technologies and quench your techie soul.What we are looking for: Azure Data EngineerYears of exp: 4-14 YearsInterview Location: Mumbai / PuneJob...