Expert Data Pipeline Designer

2 weeks ago

Hubli, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000
Freelance Data Engineer Position

We are seeking a seasoned Freelance Data Engineer with exceptional skills in designing, building, and optimizing large-scale data pipelines. As part of our team, you will collaborate closely with internal teams and clients to deliver robust, scalable, and high-performance data solutions.

Key Responsibilities:
  • Develop ETL/ELT pipelines using PySpark, AWS, and Databricks to extract, transform, and load complex data sets.
  • Use Python and SQL to perform data profiling, validation, and transformation tasks.
  • Optimize workflows for performance, scalability, and cost efficiency by leveraging automation scripts in Linux/Bash.
  • Collaborate with analytics teams to surface actionable insights and metrics.
  • Troubleshoot and resolve data inconsistencies, configuration issues, and pipeline errors.
  • Work with cross-functional teams to define and implement data requirements.
Requirements:
  • 5+ years of data engineering experience with a strong background in Python and SQL.
  • Proven expertise in PySpark, AWS services, and Databricks.
  • Proficiency in Linux/Bash scripting for automation and data operations.
  • Hands-on experience with ETL/ELT pipelines and large-scale integrations.
  • Familiarity with Agile and CI/CD practices.
  • Strong problem-solving and communication skills, with experience in client-facing roles.
Benefits:

This is an excellent opportunity for a skilled Freelance Data Engineer to join our team and contribute to delivering cutting-edge data solutions. If you possess the required skills and qualifications, we encourage you to apply.

Please submit your application with a cover letter, resume, and any relevant work samples.

  • Data Pipeline Expert

    2 weeks ago

    Hubli, Karnataka, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Databricks Engineer OpportunityWe are seeking a highly skilled Senior Databricks Data Engineer to join our dynamic data engineering team. The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.Key Responsibilities:Design, develop, and maintain scalable and high-performance data pipelines using...

  • Expert Data Pipeline Specialist

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Job OpportunityThreatXIntel is a cyber security company focused on protecting businesses and organizations from cyber threats.We offer customized cloud security, web and mobile security testing, and DevSecOps services to meet the specific needs of our clients.A key requirement for this role is designing, developing, and optimizing data...

  • Data Pipeline Specialist

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    As a Data Engineer, you will play a pivotal role in crafting and implementing scalable data pipelines to support our growing data needs. Your expertise in Bigdata, Pyspark, Python, Hadoop/HDFS, Spark, and GCP/any cloud will enable you to collaborate with analytics and business teams to refine data models and foster data-driven decision making across the...

  • Data Pipelines Engineer

    2 weeks ago

    Hubli, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000

    Big Data SpecialistWe are seeking a highly skilled professional to design, develop, and maintain robust ETL/ELT data pipelines for our organization.Key Responsibilities:Design and develop efficient ETL/ELT data pipelines using AWS services such as Lambda, DMS, and Glue.Develop and optimize Snowflake stored procedures to implement complex business logic and...

  • Data Pipeline Specialist

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a key role in designing and implementing scalable data pipelines using Azure Databricks, PySpark, and Delta Lake.ResponsibilitiesDesign and implement ETL/ELT pipelines using Azure Databricks and PySpark.Develop high-quality database programming...

  • Senior Data Pipeline Engineer

    7 days ago

    Hubli, Karnataka, India beBeeDataPipeline Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Greetings from our organizationWe are seeking a highly skilled Data Pipeline Developer to join our team.Job OverviewKey Responsibilities:1. Design, develop, and implement data pipelines using IBM Datastage.2. Collaborate with cross-functional teams to understand business requirements and develop solutions.3. Ensure high-quality deliverables and adhere to...

  • Cloud Data Expert

    2 weeks ago

    Hubli, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    As a Cloud Data Expert, you will be working on various projects and opportunities involving large-scale data processing systems.The role requires designing, building, and maintaining efficient data pipelines using Azure Data Factory, Azure Database, PySpark, and SQL. You will work closely with cross-functional teams to understand business needs and develop...

  • Senior Data Pipeline Developer

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 35,00,000 - ₹ 45,00,000

    We're seeking a seasoned professional to lead the development of complex data pipelines.**Key Responsibilities:**- Design and deploy sophisticated ETL processes using Talend Open Studio.- Utilize BigQuery for advanced SQL, partitioning, clustering, federated queries.- Leverage Python for ETL scripting, automation, and integration with cloud data pipelines.-...

  • Data Engineering Expert

    4 days ago

    Hubli, Karnataka, India beBeeEngineering Full time ₹ 18,00,000 - ₹ 21,00,000

    About the RoleWe are seeking a highly skilled data engineer to design, build, and optimize scalable data pipelines and lakehouse architectures.As a senior data engineer, you will work closely with cross-functional teams to provide thought leadership, deliver robust, secure, and high-performance data solutions that empower analytics and data science...

  • Data Pipeline Engineer

    7 days ago

    Hubli, Karnataka, India beBeeBackend Full time ₹ 80,00,000 - ₹ 1,20,00,000

    About the RoleWe are seeking a seasoned backend engineer to spearhead the development of event decoders for major DeFi protocols, including Uniswap, Curve, and Balancer. This position requires expertise in Go or Rust programming languages.The ideal candidate will play a key role in transforming raw on-chain data into actionable insights by decoding smart...