Senior Data Engineering Specialist

4 days ago

nadiad, India beBeeDataEngineer Full time

Job OverviewWe are seeking a skilled Data Engineer to join our team and drive the design, implementation, and maintenance of robust data pipelines using Google Cloud Platform (GCP) services. The ideal candidate will have hands-on experience with GCP data services and be certified in Google Cloud Professional Data Engineer.Key Responsibilities:Data Pipeline Development: Design and implement efficient data pipelines using BigQuery, Cloud Storage, and Pub/Sub.Workflow Management: Develop and manage workflows using Cloud Composer (Apache Airflow) for scheduling and orchestration.Code Development: Write clean, efficient, and scalable code in Python, leveraging advanced programming techniques.SQL Query Crafting: Craft complex SQL queries in BigQuery, including window functions, CTEs, and performance tuning strategies.Data Processing Systems: Build and maintain real-time data processing systems using Apache Kafka.NoSQL Database Management: Model and manage NoSQL databases, particularly MongoDB, with a focus on scalable schema design.Shell Scripting and Linux Administration: Utilize Shell scripting and perform Linux system administration tasks to support data infrastructure.Data Profiling and Validation: Conduct data profiling and implement validation techniques to ensure data quality and integrity. Develop and maintain API integration scripts for seamless service automation and data exchange.Troubleshooting: Troubleshoot and resolve data-related issues with strong analytical and problem-solving skills.Data Flow Diagrams: Create and maintain data flow diagrams to clearly communicate architecture and pipeline logic to stakeholders.Requirements:5+ Years of Experience: Proven hands-on experience with GCP data services.Certification: GCP Google Cloud Professional Data Engineer Certification.Distributed Systems Knowledge: Strong understanding of distributed systems and data engineering best practices.Communication Skills: Excellent communication and documentation skills.Agile Methodology: SAFe Agile methodology.Collaboration Experience: Experience working in onshore/offshore support model collaborating work with offshore teams.Technical Tools Experience: Experience working with GitHub, RTC, automation tools.AI Programming Experience: Preferred experience AI programming, IVR Technologies like AVAYA, CISCO, Chatbot etc.

  • Marketplaces senior specialist

    2 weeks ago

    Nadiad, India Social Beat Full time

    Role: Senior Specialist – Marketplaces (Amazon & E-commerce) Location : Gurgaon(In office role) Please read before applying: We’re looking for someone with prior agency experience who has managed campaigns on Amazon, Flipkart, and at least one quick commerce platform (such as Blinkit, Zepto, or Swiggy Instamart). The ideal candidate has some...

  • Senior aws data engineer

    1 week ago

    Nadiad, India CYAN360 Full time

    Position: Senior AWS Data Engineer Location: Remote Salary: Open Work Timings: 2:30 PM to 11:30 PM IST *** Need someone who can join immediately or in 15 days*** Responsibilities: Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc. Implement data...

  • Senior Data Engineer

    1 week ago

    Nadiad, India iVoyant Full time

    Our client is looking for a Senior Python Data Engineer who not only builds pipelines but also understands business context, data modeling, and why certain schemas or architectures are used. They expect strong Python problem-solving, practical experience with Polars (Must have), Pandas, Duck DB, and the ability to design data pipelines end-to-end. The role...

  • Data Engineer with Snowflake Experience- Contract

    4 weeks ago

    Nadiad, India Gravity Infosolutions, Inc. Full time

    Role:Data Engineer with Snowflake & Data Vault 2.0 Experience Type:Contract Duration:6 months+ Extendable Experience:5+ Years Location:Remote Shift:UK ShiftJob Description Project Details: The project involves setting up a new software tool to meet audit requirements and is therefore critical. Most data to be migrated is already in Snowflake; some will be...

  • Senior Data Scientist

    21 hours ago

    Nadiad, India Plant-A Insights Group Full time

    About Plant-A Insights GroupPlant-A Insights Group is a fast-growing, New York-based business and data intelligence startup. Backed by experienced technology entrepreneurs, top-tier data scientists, and market research professionals, we deliver powerful business insights through advanced analytics and strategic media collaborations. With teams across New...

  • Senior Data Scientist

    1 day ago

    Nadiad, India Plant-A Insights Group Full time

    About Plant-A Insights GroupPlant-A Insights Group is a fast-growing, New York-based business and data intelligence startup. Backed by experienced technology entrepreneurs, top-tier data scientists, and market research professionals, we deliver powerful business insights through advanced analytics and strategic media collaborations. With teams across New...

  • Principal/ senior data architect

    4 weeks ago

    Nadiad, India Aays Full time

    Position: Principal/ Senior Data Architect Desired experience: 10+ yearsYour team You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics. You will be closely working directly with senior stakeholders of the clients designing and implementing data strategy in finance...

  • Data engineer

    4 days ago

    Nadiad, India People Prime Worldwide Full time

    About Company:- A leading global information technology, consulting, and business process services organization, the company delivers innovative solutions that enable clients across industries to thrive in the digital era. With a strong focus on technology-driven transformation, it helps enterprises harness the power of cloud, AI, automation, and analytics...

  • Senior Data Scientist

    21 hours ago

    Nadiad, India Syren Full time

    Responsibilities: Feature Engineering and Data Preprocessing: Work with raw data to perform data cleaning, transformation, and feature engineering to prepare datasets for analysis. Collaborate with cross-functional teams to gather and understand data requirements. Model Deployment and Monitoring: Maintain, optimize, and scale recommendation engines used in...

  • Senior Data Scientist

    1 day ago

    Nadiad, India Syren Full time

    Responsibilities: Feature Engineering and Data Preprocessing: Work with raw data to perform data cleaning, transformation, and feature engineering to prepare datasets for analysis. Collaborate with cross-functional teams to gather and understand data requirements. Model Deployment and Monitoring: Maintain, optimize, and scale recommendation engines used in...