Azure Data Engineer(Databricks, Datafactory)

2 weeks ago

Bellary, Karnataka, India Tata Consultancy Services Full time

Azure Data Engineer

Primary Skills: SQL(Azure), Data Vault, Azure Data Factory, Blob Storage, Azure Synapse, Pipelines, Delta Lake,Databricks

Secondary Skills: Python, Apache Spark, MS Fabric (Trained Knowledge or experience), Power BI

  • Proficiency in SQL and Python. SQL being far more important.
  • Experience with Apache Spark for data processing (Python version)
  • Understanding of Delta files and Lakehouse architecture
  • Data warehouse basic knowledge or experience
  • Hands-on skills (even gotten only by training) are essential for effectively using Microsoft Fabric.
  • Practical experience in setting up end-to-end analytics, managing Lakehouse and Medallion Architecture, using Apache Spark and Delta Lake tables, handling data ingestion with Dataflows Gen2, creating pipelines with Data Factory, and setting up data warehouses is crucial.
  • Understand the capabilities of Microsoft Fabric for complete analytics solutions, including data ingestion, transformation, storage, and visualization.
  • Familiarity with features such as Direct Lake access for Power BI reports, is important.
  • Utilize Apache Spark for large-scale data processing and work with Delta Lake tables for advanced data analytics.
  • Ingest data using Dataflows Gen2 and create pipelines with Data Factory capabilities for multi-step data ingestion and transformation tasks.
  • Set up and query data warehouses in Microsoft Fabric, integrating them with other analytics components.
  • Learn how to secure a Microsoft Fabric data warehouse and administer the platform effectively.

  • Highly Skilled Data Engineer

    1 week ago

    Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary:We are seeking a highly skilled Data Engineering professional to join our team. As a key player in shaping the architecture for new data products and features, you will be responsible for defining and innovating data solutions that drive business outcomes.Key Responsibilities:Design and develop scalable data architectures using Azure services...

  • Azure Data Solutions Architect

    2 weeks ago

    Bellary, Karnataka, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 1,80,000

    As a key member of our team, we are seeking an experienced Azure Data Engineer with expertise in designing and implementing modern data engineering solutions within the Azure ecosystem.The ideal candidate will have a solid foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects.Key...

  • Databricks Architect

    2 weeks ago

    Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data EngineerWe are seeking a skilled data engineer to join our team and help design, develop, and maintain scalable, high-performance data solutions.Main Responsibilities:Design, develop, and maintain data pipelines and ETL processes on Databricks.Lead the architecture and implementation of scalable, secure, and high-performance data...

  • Azure Cloud Data Migration Specialist

    2 weeks ago

    Bellary, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleWe are seeking a seasoned data architect with expertise in designing and implementing scalable, secure data solutions within the Azure ecosystem.The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects.Key Responsibilities:Lead the...

  • Data Engineering Specialist

    2 weeks ago

    Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Greetings from our companyJob Title: Data Engineering SpecialistRequired Expertise:Azure Databricks and scalable data processingScala, PySpark programming skillsAzure Cloud platform knowledgeFull Software Development Life Cycle experienceAzure DevOps and TerraformDB/SQL and database managementScala or Python development expertiseKey Responsibilities:We are...

  • Data Platform Specialist

    2 weeks ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data EngineerWe are seeking a seasoned data engineer with expertise in designing and implementing scalable data pipelines using Azure Synapse, Databricks, and Apache Spark (PySpark). The ideal candidate will work closely with data architects, analysts, and product owners to deliver high-quality solutions that meet the needs of our business.Design,...

  • Senior Big Data Architect

    2 weeks ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Azure Data EngineerThis is a unique opportunity for experienced data engineers to work on cutting-edge projects and contribute to the company's mission to modernize and scale global enterprises.We are seeking a highly skilled data engineer to design and optimize modern data platforms using Databricks and Apache Spark.Lead Databricks architecture, development...

  • Senior Data Engineer

    1 week ago

    Bellary, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Key Responsibilities:">Data Engineer RoleTo drive innovation in healthcare revenue cycle management with cutting-edge data technology.To develop and implement scalable data solutions for reporting and analytics.Ensure best practices for ETL/ELT, data quality and collaborate with teams to integrate data.">Requirements:">8+ years of experience in data...

  • PySpark Data Solutions Architect

    2 weeks ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 30,00,000

    Job DescriptionWe are seeking an experienced Senior Data Engineer to join our team. The ideal candidate will bring hands-on expertise in PySpark, Python, SQL, and real-time data streaming to contribute to the design and implementation of scalable data pipelines in cloud environments.The selected candidate will be responsible for designing, developing, and...

  • Senior Data Engineer

    2 weeks ago

    Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 21,00,000

    Key Data Engineering RoleData engineers play a crucial role in designing and developing data pipelines and infrastructure. They collaborate closely with stakeholders to ensure accurate, timely, and accessible data.Essential Responsibilities:Pipeline Development: Develop efficient data pipelines using Azure Data Factory and Databricks for data ingestion,...