Azure Data Bricks

18 hours ago

Mumbai Maharashtra, India ScatterPie Analytics Full time

**Role Overview**:
As a Data Engineer specializing in Databricks and AWS Glue, you will play a key role in designing, developing, and maintaining data pipelines and analytics solutions for our clients. You will collaborate with cross-functional teams to understand business requirements, architect scalable solutions, and ensure data reliability and performance.

**Responsibilities**:

- Design, build, and optimize data pipelines using Databricks and AWS Glue to ingest, transform, and load large volumes of data from various sources.
- Work closely with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
- Develop ETL workflows and data processing jobs to cleanse, aggregate, and enrich data for downstream analytics and reporting.
- Implement best practices for data governance, security, and compliance, ensuring data quality and integrity throughout the pipeline.
- Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner, optimizing performance and resource utilization.
- Collaborate with cloud architects to optimize infrastructure and resource provisioning for Databricks and AWS Glue environments.
- Stay up-to-date with the latest advancements in big data technologies and best practices, continuously improving our data engineering processes and toolsets.

**Qualifications**:

- Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
- 3+ years of experience in data engineering or related roles, with a focus on building scalable data pipelines.
- Hands-on experience with Databricks and AWS Glue, including proficiency in Spark-based data processing and orchestration.
- Strong programming skills in Python, Scala, or Java, with a solid understanding of software development principles and best practices.
- Experience with cloud platforms such as AWS, Azure, or GCP, including knowledge of core services and infrastructure management.
- Familiarity with data modeling concepts, database systems, and SQL query optimization.
- Excellent problem-solving and analytical skills, with a strong attention to detail and commitment to delivering high-quality solutions.
- Ability to work independently and collaboratively in a fast-paced environment, with a passion for learning and continuous improvement.

**Good to Have**:

- Certification in Databricks or AWS related technologies.
- Experience with other big data tools and frameworks such as Apache Kafka, Apache Hadoop, or Apache Flink.
- Knowledge of machine learning concepts and libraries for advanced analytics and AI.
- Previous experience working with data visualization tools such as Tableau, Power BI, or Looker.
- Contributions to open-source projects or active participation in developer communities.

**Experience: 1-3 Years**

**Location: Mumbai**

**Job Types**: Full-time, Permanent

Pay: ₹8,874.00 - ₹45,599.09 per month

**Benefits**:

- Health insurance
- Provident Fund

Schedule:

- Day shift
- Monday to Friday

**Experience**:

- Azure Data Bricks: 1 year (required)

Work Location: In person

  • Azure Data Bricks Engineer

    4 days ago

    Mumbai, Maharashtra, India CARBYNETECH Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Azure Data Factory: Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka, Spark SQL,...

  • Azure Data Engineer

    3 weeks ago

    Mumbai, India Zensar Technologies Full time

    Excellent communication and presentation skills. Extensive experience in Azure stack Azure Data bricks, Azure Synapse, ADLS, Azure SQL DB, Azure Data Factory, CosmoDB, Analysis Services, Event Hub etc.. Excellent experience in data processing using Azure Data bricks, complex data transformation using Pyspark or Python and building end to end data pipeline...

  • Azure data Brick Engineer

    1 week ago

    Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Role: Azure data brick EngineerExperience: 6Location: Pune/GurgaonMust-Have6+ years of hands-on experience in development.Azure – cloud technology – Function Apps, AWS, Python, PySpark , Databricks, Azure DevOps, Synapse, API.Strong knowledge Incident, problem, Change management, service management, service request.Must have hands on experience code...

  • Azure Data engineer

    1 week ago

    Pune, Maharashtra, India, Maharashtra LTIMindtree Full time

    Skill: Azure Data EngineerPrimary skill. - Azure Data bricksSecondary skill- PythonExperience: 8-12 YRSRelevant into azure services: 5yrsNotice period: imm to serving NP

  • Azure Data Engineer

    1 week ago

    Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Azure Data Engineer (Data Bricks Engineer)Job location: Bangalore / Pune / Chennai / Hyderabad / GurgaonDesired Experience Range: 5 to 10 YearsJob Description:Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse, pyspark; establishing the cloud connectivity between different system like ADLS, ADF,...

  • Azure Data Bricks Engineer

    2 days ago

    Mumbai Metropolitan Region, India Embee Software Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Solution Development And ImplementationDesign, develop, and deploy robust analytics solutions leveraging the Microsoft platform (e.g., Azure Data Factory, Azure Synapse Analytics, SQL Server, Power BI, Microsoft Fabric) and Databricks.Build scalable and high-performance data pipelines and ETL processes for structured and unstructured data.Develop and...

  • Azure Data Engineer

    6 hours ago

    Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Azure Data Engineer with expertise in Azure Data Factory, Azure Databricks, and Azure Data FabricAzure Data Factory (Must Have)Azure Data Bricks (Must Have)Azure fabric (Good to have)Knowledge of Data Processing Flow with Gen AI applicationExperience working with Unstructured data (Must Have)Worked on production with more than 10000 file injection (Must...

  • Azure Sme

    1 week ago

    Pune, Maharashtra, India HoonarTek Full time

    Pune*** **About Us** - We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization. - Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner. - Using centuries of cumulative experience, research and...

  • Data Automation Engineer

    4 weeks ago

    Pune, Maharashtra, India LUXOFT Full time

    Project descriptionWorking within the client s test and government framework you will be responsible for creating the automation framework to support all data warehousing progression and regression testing and fix the defects Responsibilities Analyse and document test data results and recommendations Perform functional and non-functional testing for...

  • Data Engineer

    7 days ago

    Bengaluru, Mumbai, Navi Mumbai, India Quinnox Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Role & responsibilitiesMandatory Skills: Microsoft Fabric, Azure datafactory, Azure Data Lake Storage, Azure data bricks with Py-SparkGood to have: Power BI, Azure IAAS services.Very strong understanding on ETL and ELTVery strong understanding on Lakehouse architecture.Very strong knowledge in Pyspark and Spark architecture.Good knowledge in Azure data lake...