Big Data Engineer

2 days ago

Kurnool, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Title: Data Engineering Professional

Key Responsibilities:

  • Utilize Apache Spark for large-scale data processing.
  • Work with Delta Lake tables for advanced data analytics.

Main Skills and Qualifications:

  1. Proficient in SQL and Python, with a strong emphasis on SQL.
  2. Experience in Apache Spark for data processing using Python.
  3. Understanding of Delta files and Lakehouse architecture.
  4. Familiarity with Microsoft Fabric (hands-on skills are essential).
  5. Practical experience in setting up end-to-end analytics, managing Lakehouse and Medallion Architecture.
  6. Hands-on experience in creating pipelines with Data Factory capabilities and setting up data warehouses is crucial.
  7. Understand the capabilities of Microsoft Fabric for complete analytics solutions.
  8. Familiarity with features such as Direct Lake access for Power BI reports is important.

Role Expectations:

In this role, you will be responsible for utilizing Apache Spark for large-scale data processing and working with Delta Lake tables for advanced data analytics. Additionally, you will ingest data using Dataflows Gen2 and create pipelines with Data Factory capabilities for multi-step data ingestion and transformation tasks. You will also set up and query data warehouses in Microsoft Fabric, integrating them with other analytics components. Furthermore, you will learn how to secure a Microsoft Fabric data warehouse and administer the platform effectively.

Why This Role Matters:

This position plays a critical role in our organization's ability to process and analyze large datasets efficiently. Your expertise in data engineering will enable us to make informed business decisions and stay ahead of the competition.

What We Offer:

We offer a dynamic work environment that fosters growth and development. Our team is passionate about innovation and collaboration, and we provide opportunities for professional growth and advancement.

  • Cloud Big Data Architect

    15 hours ago

    Kurnool, Andhra Pradesh, India beBeeBigData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Description:We are seeking a highly skilled professional to join our organization in the role of Big Data Engineer with deep expertise in Big Data technologies and cloud computing.Main Responsibilities:Design, develop, and optimize big data architectures leveraging cloud services for large-scale, complex data processing.Build and maintain data pipelines...

  • Strategic Big Data Solutions Specialist

    7 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Engineer PositionWe are seeking a highly skilled Big Data Engineer to fill a key role in our organization.Design and implement large-scale big data solutions using technologies such as PySpark, Hive, Spark, HBase, and DQ tools to drive business growth and success.Develop and maintain scalable data pipelines to ingest data from disparate sources onto...

  • Senior Big Data Developer

    3 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineer WantedWe are seeking a skilled Data Engineer to lead our distributed data systems. The successful candidate will be responsible for designing, executing and managing large and complex distributed data systems.The ideal candidate will have experience in big data technologies (Apache Hadoop) and relational databases (MySQL/PostgreSQL)....

  • Chief Data Architect

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Engineering Leadership OpportunityWe are seeking an experienced engineering leader to oversee the development of scalable data pipelines and analytics platforms. The ideal candidate will lead a team of talented data engineers, leveraging expertise in Big Data platforms, Microsoft Azure, and Databricks.About the Role:Lead a team of data engineers working on...

  • Enterprise Big Data Specialist

    15 hours ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Development PositionA leading organization seeks an experienced big data developer to join their team.As a big data developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Apache Spark, SQL, Hive, and Scala.Developing and deploying scalable data pipelines...

  • Big Data Innovator

    2 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerThe ideal candidate for this position is a skilled professional with expertise in data engineering and a strong passion for delivering high-quality solutions. Key Responsibilities:We are looking for an individual who can interact directly with customers, requiring excellent communication skills.A strong background in Azure/AWS...

  • Expert Big Data Solutions Architect

    15 hours ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 1,10,00,000 - ₹ 2,21,00,000

    About the RoleOur organization specializes in digital engineering and technology solutions.We focus on executing complex business challenges with creativity and innovation.Job OverviewWe are seeking a seasoned professional with expertise in Big Data technologies and Google Cloud Platform services.Main Responsibilities:Data Pipeline Development: Design,...

  • Senior Big Data Expert

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data ExpertAs a senior big data expert, you will be responsible for designing and implementing large-scale data systems.Key Responsibilities:Design and implement high-performance data warehouses using Trino (PrestoSQL).Develop and maintain complex SQL queries to optimize database performance.Collaborate with cross-functional teams to...

  • Lead Big Data Analyst

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeDataScientist Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Data Scientist RoleWe are seeking a highly skilled Data Scientist to join our team. As a Data Scientist, you will be working with large datasets to gain valuable insights and drive business growth through data-driven decisions.Key Responsibilities:Create and implement complex data models to process and analyze big dataDesign and optimize efficient data...

  • Advanced Hadoop Big Data Solutions Engineer

    3 days ago

    Kurnool, Andhra Pradesh, India beBeeBigDataDeveloper Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Overview:We are seeking a highly skilled Hadoop Big Data Developer to fill this key role.About the Position:This is an opportunity to work with large-scale data processing using Hadoop and its ecosystem tools.The ideal candidate will have hands-on experience with Scala, Spark, Hive, and other Big Data Eco System Tools.Strong SQL skills are required,...