Senior Big Data Specialist

3 days ago

Allahabad, Uttar Pradesh, India beBeeDataSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title: Senior Big Data Specialist

We are seeking an experienced professional to design and implement scalable data pipelines and architectures on modern cloud & big data platforms.

Key Responsibilities:
  • Design, develop, test, and deploy large-scale data processing systems and workflows using tools like Databricks (Delta Lake, Workflows, CLI, Job Clusters, Workspace) and AWS.
  • Collaborate with cross-functional teams to understand business requirements and design data architectures that meet the needs of stakeholders.
  • Develop and maintain ETL processes and data pipelines using technologies such as Python, PySpark, SQL, and Bash scripting.
  • Work closely with data scientists to integrate machine learning models into production-ready workflows.
  • Ensure high-quality code, documentation, and deployment practices.
Requirements:
  • 3-6 years of experience in building scalable data pipelines and working on modern cloud & big data platforms.
  • Strong expertise in Python, SQL, PySpark, Bash scripting, and containerization (Docker/Kubernetes).
  • Experience in ETL, data pipelines, structured/unstructured data, and Cloud Data Warehousing (Redshift, Snowflake, Databricks SQL, or equivalent).
  • Familiarity with ML lifecycle & libraries (scikit-learn, XGBoost), REST APIs, Flask/FastAPI, and CI/CD (Jenkins), Git, orchestration tools (Airflow/Prefect).
  • Excellent communication & collaboration skills.

  • Big Data Analytics Specialist

    5 days ago

    Allahabad, Uttar Pradesh, India beBeeAnalytics Full time ₹ 8,00,000 - ₹ 16,00,000

    Job Title: Big Data Hadoop Scala EngineerWe are seeking an experienced Big Data Analytics Specialist to join our team. The ideal candidate will have hands-on experience with Scala, Spark, Hive, and Hadoop Big Data Eco System Tools.Key Responsibilities:Data Analysis and Optimization: Develop and optimize complex queries using SQL, focusing on performance...

  • Big Data Specialist

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerThe ideal candidate will have strong technical expertise in cloud computing, data processing tools, and advanced data pipeline design along with excellent communication and problem-solving skills.Key Responsibilities:Design and develop scalable data solutions using cloud-based technologies, ETL frameworks, and big data...

  • Senior Big Data Specialist

    5 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineering RoleWe are seeking a skilled professional to fill the position of Data Engineer.Responsibilities:Design and develop large-scale data systems.Optimize existing projects for improved performance.Research and implement Big Data tools and frameworks.Develop scalable solutions that meet business/data requirements.Create reusable components and...

  • Big Data Analyst

    5 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Data Analyst SpecialistWe are seeking a skilled data analyst to join our team.Overview:The position is ideal for professionals with 6–12 years of experience in big data and related technologies. As a data analyst, you will be responsible for analyzing and interpreting large datasets to gain insights and make informed...

  • Big Data Solutions Specialist

    2 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Senior Data Analytics ExpertWe are seeking a seasoned professional with extensive experience in Big Data technologies and Google Cloud Platform services to design and implement scalable data solutions.Design, develop and optimize data pipelines using GCP BigQuery, Dataflow and Apache Airflow to support large-scale data analytics.Utilize the Big Data Hadoop...

  • Big Data Specialist

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a skilled professional to design and develop scalable data pipelines using various tools and technologies.The ideal candidate will have experience in designing, developing, and maintaining ETL/ELT pipelines, integrating structured and unstructured data from diverse sources, and implementing IoT data ingestion, processing, and...

  • Big Data Expert

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 40,00,000

    Greetings from our organizationOur Team is Looking for a Talented Big Data ProfessionalYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiNotice Period: 0 - 45 daysJob Description:We are Seeking Highly Skilled Professionals to Join Our TeamPySparkHiveKey Skills:SparkHBaseData Quality toolsAgile Scrum methodologiesData ingestion from multiple...

  • Big Data Innovator

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Data ScientistOur organization seeks a Data Scientist to create and implement big data solutions using Spark, Python, and other relevant technologies.

  • Highly Skilled Senior Big Data Professional

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data Engineer PositionJob Description:Key ResponsibilitiesData Pipeline Development: Develop efficient ETL pipelines as per business requirements, following the development standards and best practices.Integration Testing: Perform integration testing of different created pipeline in Cloud environment.Estimation and Deployment: Provide estimates for...

  • Data Engineering Specialist

    1 week ago

    Allahabad, Uttar Pradesh, India beBeeBigData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering SpecialistJob Overview:As a Data Engineering Specialist, you will play a pivotal role in designing and developing large-scale data processing systems using cutting-edge technologies.This challenging position requires expertise in big data technologies, including PySpark and Hive. Familiarity with Spark, HBase, and data quality...