Data Bricks Developer

14 hours ago

Mumbai, India Tata Technologies Full time

Purpose of the Role:We are seeking a skilled Databricks with 4 to 6 years of experience in data engineering and cloud platforms. Designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modelling, and cloud integration, ensuring high performance, security, and reliability.Job Responsibilities:- Design and implement Databricks-based data architectures to meet business requirements.- Develop and optimize data pipelines using PySpark, Scala, or SQL.- Establish the Databricks Lakehouse architecture for batch and streaming data.- Collaborate with cross-functional teams to integrate Databricks with cloud platforms (e.g., AWS, Azure, GCP).- Ensure data security and compliance with best practices.- Monitor and troubleshoot Databricks environments for performance and reliability.- Stay updated on Databricks advancements and industry trends.-Desired Candidate Profile:- 4 to 6 years of experience in data engineering using Databricks or Apache Spark-based platforms.- Proven track record of building and optimizing ETL/ELT pipelines for batch and streaming data ingestion.- Good understanding of AWS cloud services- Proficiency in programming languages such as Python, Scala, or SQL for data processing and transformation.- Expertise in Spark (PySpark, Spark SQL, or Scala) and Databricks notebooks for large-scale data processing.- Familiarity with Delta Lake, Delta Live Tables, and medallion architecture for data lake house implementations.- Build and query delta lake storage solutions- Process streaming data with Azure Databricks structured streaming- Design Azure Databricks security and data protection solutions- Flatten nested structures and explode arrays with spark- Experience with orchestration tools like Databricks Jobs for scheduling and automation.- Knowledge of Git for source control and CI/CD integration for Databricks workflows, cost optimization, performance tuning.- Familiarity with Unity Catalog, RBAC, or enterprise-level Databricks setups.- Ability to create reusable components, templates, and documentation to standardize data engineering workflows.- Solutioning and presales - Architecting frameworks, defining roadmaps, and engaging with stakeholders.- Experience in defining data strategy, evaluating new tools/technologies, and driving adoption across the organization.- Must have experience of working with streaming data sources and Kafka.Preferred Experience:- Bachelor’s degree in computer science, Information Technology, or related field- Proven experience as a Databricks Architect or similar role- Complete knowledge in Azure Databricks platform architecture- Databricks certification (e.g., Certified Data Engineer, Associate Developer)- Expertise in Python/Scala/ SQL/R- Experience with cloud platforms like AWS, Azure, or GCP- Strong understanding of data modelling and cloud integration

  • Azure Data Bricks

    2 weeks ago

    Mumbai, Maharashtra, India ScatterPie Analytics Full time

    **Role Overview**: As a Data Engineer specializing in Databricks and AWS Glue, you will play a key role in designing, developing, and maintaining data pipelines and analytics solutions for our clients. You will collaborate with cross-functional teams to understand business requirements, architect scalable solutions, and ensure data reliability and...

  • Business development manager

    3 weeks ago

    Mumbai, India Matrix Bricks Full time

    Company DescriptionMatrix Bricks is where superior technology meets creativity to optimize the performance of your business in the global market. Established in 2011, Matrix Bricks has achieved numerous milestones in areas such as web designing, web hosting, search engine optimization, content management, offshore outsourcing, internet marketing, and online...

  • Business Development Manager

    3 weeks ago

    Mumbai, India Matrix Bricks Full time

    Company Description Matrix Bricks is where superior technology meets creativity to optimize the performance of your business in the global market. Established in 2011, Matrix Bricks has achieved numerous milestones in areas such as web designing, web hosting, search engine optimization, content management, offshore outsourcing, internet marketing, and online...

  • Business Development Manager

    4 weeks ago

    Mumbai, India Matrix Bricks Full time

    Company Description Matrix Bricks is where superior technology meets creativity to optimize the performance of your business in the global market. Established in 2011, Matrix Bricks has achieved numerous milestones in areas such as web designing, web hosting, search engine optimization, content management, offshore outsourcing, internet marketing, and online...

  • Business Development Manager

    4 weeks ago

    Mumbai, India Matrix Bricks Full time

    Company DescriptionMatrix Bricks is where superior technology meets creativity to optimize the performance of your business in the global market. Established in 2011, Matrix Bricks has achieved numerous milestones in areas such as web designing, web hosting, search engine optimization, content management, offshore outsourcing, internet marketing, and online...

  • Business Development Manager

    4 weeks ago

    Mumbai, India Matrix Bricks Full time

    Company Description Matrix Bricks is where superior technology meets creativity to optimize the performance of your business in the global market. Established in 2011, Matrix Bricks has achieved numerous milestones in areas such as web designing, web hosting, search engine optimization, content management, offshore outsourcing, internet marketing, and online...

  • Business Development Manager

    2 weeks ago

    Mumbai, Maharashtra, India Matrix Bricks Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionMatrix Bricks is where superior technology meets creativity to optimize the performance of your business in the global market. Established in 2011, Matrix Bricks has achieved numerous milestones in areas such as web designing, web hosting, search engine optimization, content management, offshore outsourcing, internet marketing, and online...

  • Lead Generation Specialist

    2 days ago

    Navi Mumbai, Maharashtra, India Matrix Bricks Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Company DescriptionMatrix Bricks, established in 2011, specializes in delivering a wide range of IT services, including web design, SEO, content management, internet marketing, and online reputation management. The company combines superior technology and creativity to enhance business performance in the global market. Matrix Bricks differentiates itself...

  • Azure Data Bricks Engineer

    3 days ago

    Mumbai, India Carbynetech Full time

    Job Description Job description Azure Data Factory: - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data...

  • Azure Data Bricks

    2 weeks ago

    Mumbai, Maharashtra, India Capgemini Full time

    **Job Description**: - Experience with Azure Data Bricks, Data Factory - Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics - Experience in Python/ Pyspark Programming. - Experience with Azure Databricks/ADB - Experience with building CI/CD pipelines in Data environments **Primary Skills**: - Azure...