Freelance Big Data Specialist

3 days ago

Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Title

We are seeking a highly skilled Freelance Data Engineer with expertise in designing, building, and optimizing large-scale data pipelines using Python, SQL, and cloud-based technologies.

  • Data Engineering Expertise: Develop and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks to extract, transform, and load data from various sources.
  • Big Data Analytics: Perform data profiling, validation, and transformation using Python and SQL to identify trends and patterns in large datasets.
  • Pipeline Optimization: Optimize and monitor workflows for performance, scalability, and cost efficiency to ensure smooth data processing.
  • Automation Scripts: Build automation scripts using Linux and Bash to orchestrate data pipeline operations.
  • Collaboration: Collaborate with analytics teams to surface trustworthy KPIs and metrics that inform business decisions.
  • Troubleshooting: Troubleshoot and resolve data inconsistencies, configuration issues, and pipeline errors to ensure seamless data flow.

The ideal candidate should have 5+ years of experience in data engineering with a strong background in Python and SQL. Proficiency in PySpark, AWS services, and Databricks is required, as well as expertise in Linux/Bash scripting for automation and data operations.

This position offers the opportunity to work on complex data projects, develop new skills, and contribute to the success of our organization.

The successful candidate will be responsible for:

  • Designing, developing, and maintaining large-scale data pipelines using cloud-based technologies.
  • Performing data analysis and visualization to identify trends and patterns in large datasets.
  • Optimizing and monitoring workflows for performance, scalability, and cost efficiency.
  • Building automation scripts using Linux and Bash to orchestrate data pipeline operations.
  • Collaborating with cross-functional teams to define and implement data requirements.

We offer a competitive compensation package, opportunities for professional growth and development, and a dynamic work environment.

  • Big Data Expert

    4 days ago

    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 40,00,000

    Greetings from our organizationOur Team is Looking for a Talented Big Data ProfessionalYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiNotice Period: 0 - 45 daysJob Description:We are Seeking Highly Skilled Professionals to Join Our TeamPySparkHiveKey Skills:SparkHBaseData Quality toolsAgile Scrum methodologiesData ingestion from multiple...

  • Freelance Oracle SOA

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeFreelance Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Freelance Oracle SOA & HRMS Technical SpecialistOur client is seeking an experienced Freelance Oracle SOA & HRMS Technical Specialist to support integration and technical development needs in Oracle E-Business Suite (EBS).About the RoleWe are looking for a skilled Freelance Oracle SOA & HRMS Technical Specialist to deliver high-quality solutions...

  • Data Engineering Specialist

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeBigData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering SpecialistJob Overview:As a Data Engineering Specialist, you will play a pivotal role in designing and developing large-scale data processing systems using cutting-edge technologies.This challenging position requires expertise in big data technologies, including PySpark and Hive. Familiarity with Spark, HBase, and data quality...

  • Big Data Solutions Specialist

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data EngineerWe are seeking a highly skilled professional with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team.Key Responsibilities:Design, develop, and optimize large-scale data pipelines and distributed data processing systems.Work extensively with Scala, Spark (PySpark), and Python for data...

  • Lead Big Data Engineer

    7 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a senior data engineer to lead our big data engineering team. As a key member of the team, you will be responsible for developing architectures that meet business needs and providing technical leadership.The role involves setting up cloud-based data lakes and implementing standardized data models. You will develop data pipelines...

  • Freelance Creative Specialist

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeIllustrator Full time ₹ 37,50,000 - ₹ 62,50,000

    At Scopio, we connect creatives with a global community of photographers, videographers, and graphic designers.Job Overview:We are seeking an accomplished Freelance Illustrator to create digital illustrations, develop graphics and designs. The ideal candidate will possessDigital illustration, drawing, and painting expertiseGraphics and graphic design...

  • Big Data Developer

    3 days ago

    Allahabad, Uttar Pradesh, India beBeeDataInfrastructure Full time ₹ 12,50,000 - ₹ 17,50,000

    Job Title: Data Infrastructure SpecialistSeeking a seasoned data architect to design and build scalable data systems that handle high-volume financial information.This role involves leading the development of robust data pipelines that ensure data integrity, reliability, and real-time availability across our platforms.The ideal candidate will have expertise...

  • Big Data Specialist

    6 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    Data Engineering RoleJob Title: Data EngineerWe are seeking a skilled Data Engineer to support data-driven initiatives.This role involves designing scalable pipelines, working with streaming data, and collaborating with data scientists and stakeholders to deliver high-quality solutions.Key Responsibilities:Design, build, and optimize data pipelines and ETL...

  • Data Engineer

    4 days ago

    Allahabad, Uttar Pradesh, India beBeeInformatica Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Data Engineer - Informatica SpecialistAbout the RoleThe successful candidate will be responsible for designing and developing scalable ETL workflows using Informatica BDM/DEI. This will involve integrating data from structured and unstructured sources, including big data platforms.The ideal candidate will have strong data warehousing concepts to...

  • Senior Big Data Specialist

    4 days ago

    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,60,00,000 - ₹ 2,40,00,000

    Job OverviewWe are seeking an experienced data professional to join our team as a Data Engineer. The ideal candidate will have strong expertise in PySpark and hands-on experience in building scalable data pipelines.The successful candidate will be responsible for designing, developing, and maintaining batch and streaming data pipelines. They will also ensure...