High-Performance Data Engineer

5 days ago


thane, India beBeeDataEngineering Full time

Job DescriptionWe are seeking a highly skilled Freelance Data Engineer to design, implement and optimize real-time data pipelines using the Google Cloud Platform (GCP) ecosystem.This role involves working with various GCP services including BigQuery, Pub/Sub, Dataflow and Cloud Storage to ensure high-performance data processing, transformation and delivery to downstream systems for analytics and reporting.Data Ingestion Pipelines: Design and implement real-time data ingestion pipelines using Apache NiFi for structured and unstructured data.Ecosystem Integration: Integrate data pipelines with the GCP ecosystem, including BigQuery, Pub/Sub, Dataflow, Dataproc, Cloud Storage and Composer/Airflow.Data Delivery: Ensure low-latency, high-throughput data delivery to downstream systems for analytics and reporting.SQL Development: Develop and optimize SQL queries for BigQuery and relational databases to ensure data transformation and analysis.Data Automation: Write Python scripts for data transformation, automation and custom NiFi processors when required.Data Quality and Error Handling: Implement data quality, validation and error-handling mechanisms within ingestion pipelines to ensure reliability and accuracy.Collaboration: Collaborate with data analysts, data scientists and platform engineers to deliver consistent and high-quality datasets.Data Security and Governance: Ensure data security, governance and compliance with GCP IAM, VPC Service Controls and encryption standards.Pipeline Performance Monitoring: Monitor, troubleshoot and optimize data pipeline performance to ensure smooth operations.Documentation: Document data flows, architecture and best practices to maintain consistency across teams.About the Role: As a Freelance Data Engineer, you will be responsible for designing, implementing and optimizing real-time data pipelines using the Google Cloud Platform (GCP) ecosystem. This role involves working with various GCP services including BigQuery, Pub/Sub, Dataflow and Cloud Storage to ensure high-performance data processing, transformation and delivery to downstream systems for analytics and reporting.



  • thane, India beBeeBackend Full time

    High-Performance Backend Developer OpportunityAs a seasoned backend developer, you will play a pivotal role in designing and implementing high-performance systems that meet the needs of our rapidly growing user base.Develop scalable and reliable software solutions using modern programming languages (Java, Python, Go, Node.js, C#, Scala)Design and implement...


  • thane, India beBeeDataScientist Full time

    Key ResponsibilitiesWe are seeking a highly skilled Data Scientist to join our team and contribute to the development of advanced generative AI models.As a key individual contributor, you will be responsible for researching, designing & building high-performance ML/DL models using state-of-the-art architectures.Develop machine learning algorithms and deploy...


  • thane, India beBeeBackend Full time

    As a Software Developer, you will design and develop high-performance backend APIs and services using .NET Core.You will work with relational (MS-SQL) and NoSQL databases to create optimized data models and ensure data consistency and performance.Collaborate with cross-functional teams to deliver high-quality software solutions.Ensure adherence to quality...


  • thane, India beBeeSoftware Full time

    We're seeking a seasoned software engineer to join our high-performing team.Job DescriptionAs a key member of our engineering team, you will be responsible for designing and implementing mission-critical systems that drive business growth. You will collaborate closely with cross-functional teams to develop innovative solutions that meet the needs of our...


  • thane, India beBeeData Full time

    Technical Sales Expert for High-Performance Data SolutionsWe're looking for a skilled professional who can architect scalable data solutions and drive technical sales for distributed database platforms.Engage with customers to understand business drivers and technical challenges, delivering value through high-performance data architectures.Deliver compelling...


  • thane, India beBeeBackend Full time

    We are on the lookout for a visionary engineer to spearhead our backend operations. About the RoleThis is a unique opportunity to own and shape core systems, driving innovation and growth within our organization.Key Responsibilities:Spearheading Backend Innovation: Design, build, and scale high-performance systems using Python (FastAPI) to ensure seamless...


  • thane, India beBeeMachineLearning Full time

    Freelance Machine Learning EngineerAs a Freelance Machine Learning Engineer, you will join a team of skilled developers in designing and deploying high-performance ML models into production-grade environments. Key responsibilities include setting up and managing MLOps pipelines for continuous training and versioning, automating data processing and deployment...


  • thane, India beBeeBackend Full time

    Job DescriptionOur organization is a reputable global IT services provider, headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services.Job Summary:We are seeking a highly skilled Senior Backend Developer with strong hands-on experience in building scalable,...

  • Data engineer

    3 weeks ago


    Thane, India Azilen Technologies Full time

    Job purpose: Manage and create design schema, SQL query tuning, and code review. Who you are: Min 4+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH development Min. 2 years of hands-on experience in SSAS tabular models Designed Data Ingestion and Orchestration Pipelines with Kafka and Python...


  • thane, India beBeeDistributedSystems Full time

    Job DescriptionAt the forefront of cutting-edge technology, we're driven to empower individuals and businesses worldwide.The Senior Distributed Systems Engineer role focuses on leveraging distributed systems technologies including Apache Ozone, Apache Spark, and Apache Kafka to craft enterprise-grade platforms capable of handling massive scales.This position...