Senior Big Data Specialist

2 weeks ago

Nagpur, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

Job Title: Data Engineer

Job Description

We are seeking a seasoned Data Engineer to support our organization's data-driven initiatives.

Key Responsibilities:

  • Design and Optimize Data Pipelines: Develop, test, and deploy scalable data pipelines and ETL workflows.
  • Big Data Processing: Manage and process large datasets using Spark, PySpark, and SQL.
  • Real-Time Streaming: Build and maintain real-time streaming applications with Spark Streaming/Kafka.
  • AI/ML Integration: Collaborate with data scientists and product teams to integrate AI/ML models into production.
  • Ensure Data Quality and Scalability: Ensure high-quality, scalable, and performant data pipelines.
  • Cloud Deployment: Deploy and manage Spark workloads on cloud platforms (AWS, Azure, GCP, Databricks).
  • Automate Testing and Deployment: Automate testing and deployment of Spark jobs via CI/CD pipelines.
Required Skills and Qualifications

Education: Bachelor's/Master's degree in Computer Science, Computer Engineering, or related field.

Experience: Minimum 4 years of professional experience as a Data Engineer.

Technical Skills: Strong expertise in Python, Spark, PySpark. Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution. Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC). Familiarity with Airflow/Prefect for scheduling and orchestration. Proficiency in performance tuning in Spark (partitioning, caching, broadcast joins). Experience deploying on Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc.

Benefits

Our organization offers a collaborative work environment, opportunities for growth and development, and a competitive salary and benefits package.

About Us

Our organization is dedicated to delivering innovative solutions that drive business results. We are committed to excellence and are seeking talented individuals who share our vision and values.

  • Senior Big Data Solutions Specialist

    2 weeks ago

    Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityRole Description:This is a Data Engineer role where the successful candidate will be responsible for designing and implementing big data solutions, leading teams efficiently and having experience with Agile methodology.Required Skills and Qualifications:Expertise in Big Data technologiesStrong knowledge of distributed computing...

  • Big Data Specialist

    2 weeks ago

    Nagpur, Maharashtra, India beBeeData Full time ₹ 90,00,000 - ₹ 1,50,00,000

    Job Title: Big Data SpecialistWe are seeking an expert in data engineering with a strong background in Python to drive business insights. The ideal candidate should possess hands-on experience in handling large datasets, data cleaning, analysis, and visualization.Key Responsibilities:Develop efficient Python scripts for data collection and...

  • Big Data Pipeline Architect

    1 week ago

    Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data EngineerJob Description:We are seeking a highly skilled Senior Data Engineer to develop, construct, test and maintain data acquisition pipelines for large volumes of structured and unstructured data.The ideal candidate will have experience in building large and complex datasets based on business requirements, as well as constructing 'big data'...

  • Senior Big Data Analyst

    2 weeks ago

    Nagpur, Maharashtra, India beBeeDataScientist Full time ₹ 15,00,000 - ₹ 25,00,000

    Key Big Data RoleA pivotal position in our organization, the key player will be instrumental in shaping and executing a comprehensive big data strategy.Job Overview:The ideal candidate will possess expertise in big data technologies and real-time data processing platforms, with a strong foundation in computer science fundamentals: data structures,...

  • Big Data Professional

    1 week ago

    Nagpur, Maharashtra, India beBeeBigData Full time ₹ 30,00,000 - ₹ 50,00,000

    About the Big Data RoleWe are seeking an experienced professional to design, develop and implement big data solutions using cutting-edge technologies.Key responsibilities include developing and implementing scalable data architectures, ensuring high-performance data processing, and collaborating with cross-functional teams to drive business outcomes.Our...

  • Big Data Developer

    4 weeks ago

    Nagpur, Maharashtra, India DigiHelic Solutions Pvt. Ltd. Full time

    Job descriptionKey Responsibilities:Big Data Architecture: Design, develop, and maintain scalable and distributed data architectures capable of processing large volumes of data.Data Storage Solutions: Implement and optimize data storage solutions using technologies such as Hadoop, Spark, and PySpark.PySpark Development: Develop and implement efficient ETL...

  • Big Data Engineer

    2 weeks ago

    Nagpur, Maharashtra, India Naukri E Hire Campaign Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role- Big dataExperience- 3 to 5 yrsLocation- NagpurInterview mode- 2 Virtual roundNotice period- 30 daysInterview date- 23rd AugJob Summary:We are looking for a skilled Big Data Developer with strong expertise in Apache Spark, Scala, and Linux to join our dynamic data engineering team. The ideal candidate will design, develop, and maintain big data...

  • Big Data Developer

    1 week ago

    Nagpur, Maharashtra, India Naukri E Hire Campaign Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Roles and Responsibilities :Design, develop, test, deploy and maintain large-scale big data solutions using Scala and Spark.Collaborate with cross-functional teams to gather requirements and deliver high-quality software products.Troubleshoot complex issues related to big data processing pipelines and provide timely resolutions.Stay up-to-date with industry...

  • Big Data Solutions Specialist

    2 weeks ago

    Nagpur, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Developers are instrumental in driving business growth through effective data management and analysis.

  • Senior Technical Consultant

    1 week ago

    Nagpur, Maharashtra, India beBeeBigDataDeveloper Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a skilled professional to join our team as a Big Data Developer. This role is ideal for an experienced developer who thrives in a technical, fast-paced environment and is passionate about coaching and developing the next generation of talent.The successful candidate will work on live client projects, provide technical support,...