Big Data Specialist

4 hours ago

Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Description

We seek an experienced Big Data Specialist to design and develop scalable ETL pipelines for batch data ingestion and egress.

The ideal candidate will have a strong background in Python, Scala, and Azure Cloud technologies.

Key Responsibilities
  • Develop and maintain ETL pipelines using Azure Data Factory, Databricks, and Spark.
  • Implement data transformation workflows using PySpark and Scala Spark for high-performance data processing.
  • Collaborate with technical teams to translate business requirements into effective data solutions.
Required Skills and Qualifications
  • Microsoft Certified: Azure Fundamentals (preferred)
  • Strong programming skills in Python and Scala.
  • Hands-on experience with Spark (PySpark & Scala Spark).
  • Proficiency in SQL for data querying and transformation.

Working extensively with Azure Cloud services including Azure Data Lake, Azure Data Factory, and related services is essential for this role. A proven ability to troubleshoot jobs and analyze root causes is also required.

Benefits
  • Maintaining detailed documentation for solutions, processes, and troubleshooting guides is required.
  • Experience with designing and optimizing ETL pipelines, working with Databricks, and managing large-scale data processing workflows is highly desirable.
Others

Our team is looking for someone who can work effectively with us to achieve our goals. If you are passionate about working with big data and have the necessary skills, please apply for this role.

  • Expert Big Data Professional

    3 days ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    Big Data Cluster SpecialistWe are seeking an experienced Big Data specialist to manage and maintain our Cloudera cluster. The ideal candidate will have a strong background in administering large-scale data processing systems.Key Responsibilities:Building and managing distributed data processing environmentsMigrating data between platforms to ensure seamless...

  • Big Data Pipeline Specialist

    2 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataPipeline Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Opportunity: Data Pipeline SpecialistOur company seeks a skilled and experienced professional to build and maintain large-scale data pipelines using AWS services.Key Responsibilities:Design, develop, and implement production-level data pipelines that handle structured and unstructured data at terabyte scale.Own the end-to-end ETL/ELT processes, ensuring...

  • Senior Big Data Engineer

    6 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data EngineerAbout the RoleWe are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have a strong background in big data technologies and experience working with large-scale data processing systems.The successful candidate will be responsible for designing, implementing, and maintaining scalable...

  • Big Data Database Management Specialist

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDatabase Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data Database Management Specialist">Our team is looking for a skilled Big Data Database Management Specialist to lead the administration and management of our data platforms. As a key member of our IT department, you will be responsible for designing, implementing, and maintaining database systems that support our business operations.">The...

  • Senior Big Data Architect

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 30,00,000 - ₹ 40,00,000

    We're looking for a seasoned leader to spearhead our big data initiatives.The ideal candidate will have a proven track record of building scalable and extensible big data platforms, providing the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This role requires strong technical expertise, excellent...

  • Chief Big Data Architect

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDistributed Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Role OverviewAt a leading data-driven organization, we are seeking an experienced Data Engineer with expertise in Apache Ray to play a pivotal role in our team.Key Responsibilities:Deep understanding of Distributed Computing FrameworksOperate, monitor, and troubleshoot all aspects of our production and non-production environments.Automate...

  • Data Engineering Specialist

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering SpecialistJob Description:We are seeking a highly skilled Data Engineering Specialist to join our team. As a key member of the data engineering team, you will be responsible for designing and implementing scalable data solutions that meet the needs of our business.The ideal candidate will have a strong background in data...

  • Data Administration Specialist

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeDataAdministration Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Data Administration SpecialistWe are seeking an experienced professional to fill the role of a Data Administration Specialist.The ideal candidate will have a strong background in data processing and administration, with experience in managing large datasets and ensuring data quality.Responsibilities:Manage Databricks clusters, notebooks,...

  • Data Architecture Specialist

    1 day ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 40,00,000 - ₹ 50,00,000

    Job Title: Data Architecture SpecialistWe are seeking a highly skilled professional to design, construct and optimize large-scale data processing systems that enable advanced analytics and business intelligence.About the RoleDesign, develop and maintain scalable and robust data pipelines that collect, process and store large volumes of structured and...

  • Data Engineering Specialist

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Title: Data Engineering SpecialistThis is an exciting opportunity to join our dynamic data team as a Data Engineering Specialist. We are seeking an experienced professional to design, build, and maintain robust data pipelines and ETL/ELT processes.About the Role:We are looking for a highly skilled Data Engineer who can work collaboratively with our...