Senior Data Engineer
19 hours ago
Senior Data Engineer – GCP Job Overview: We are looking for a skilled and motivated Senior Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems. Experience Level: 4 to 8 years of relevant IT experience Key Responsibilities: Design, develop, test, and maintain scalable ETL data pipelines using Python. Work extensively on Google Cloud Platform (GCP) services such as: Dataflow for real-time and batch data processing Cloud Functions for lightweight serverless compute BigQuery for data warehousing and analytics Cloud Composer for orchestration of data workflows (based on Apache Airflow) Google Cloud Storage (GCS) for managing data at scale IAM for access control and security Cloud Run for containerized applications Should have experience in the following areas : API framework: Python FastAPI Processing engine: Apache Spark Messaging and streaming data processing : Kafka Storage: MongoDB, Redis/Bigtable Orchestration: Airflow Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery. Implement and enforce data quality checks, validation rules, and monitoring. Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions. Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects. Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL. Document pipeline designs, data flow diagrams, and operational support procedures. Required Skills: 4-8 years of hands-on experience in Python for backend or data engineering projects. Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.). Solid understanding of data pipeline architecture, data integration, and transformation techniques. Experience in working with version control systems like GitHub and knowledge of CI/CD practices. Experience in Apache Spark, Kafka, Redis, Fast APIs, Airflow, GCP Composer DAGs. Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.). Experience in data migrations from on-premise data sources to Cloud platforms. Good to Have (Optional Skills): Experience working with Snowflake cloud data platform. Experience in deployments in GKE, Cloud Run. Hands-on knowledge of Databricks for big data processing and analytics. Familiarity with Azure Data Factory (ADF) and other Azure data engineering tools. Additional Details: Excellent problem-solving and analytical skills. Strong communication skills and ability to collaborate in a team environment.
-
Senior Data Engineer
2 weeks ago
Jamnagar, India iPath Infotech Full timeCompany Description At iPath Infotech, we assist businesses around the globe with top-notch IT solutions. We specialize in mobile app development, web development, BPO, software development, and managed services. Our team is dedicated to delivering exceptional results tailored to meet client needs. With a focus on affordable, high-quality solutions, we...
-
Senior data engineer
18 hours ago
Jamnagar, India TeamLease Edtech Full timeTeam Lease Ed Tech, part of Team Lease Services, focuses on making India employable through online, work-integrated, and distance learning programs. It partners with 50+ universities and 4,000+ corporates to deliver degree, diploma, and upskilling programs. Their “Digivarsity” platform enables students to study while gaining real-world work experience....
-
Jamnagar, India Crest Data Full timeWe are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location: PUNE / AHMEDABAD ( WFO Only)Key Responsibilities -- Responsible for providing expertise in...
-
Senior data engineer
3 weeks ago
Jamnagar, India Persistent Systems Full timeAbout Position: We are looking for a highly skilled and innovative Senior Data Engineer with strong expertise in Azure Databricks, Py Spark, and Snowflake, along with hands-on experience integrating AI tools such as Chat GPT, Copilot, or Databricks AI Functions. The ideal candidate will architect and build scalable data pipelines, enable intelligent data...
-
Senior Engineer I
2 weeks ago
Jamnagar, India lululemon Full timeAbout lululemon:lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...
-
Senior Engineer I
2 weeks ago
Jamnagar, India lululemon Full timeAbout lululemon:lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...
-
Sr. Site Reliability Engineer, L2(Network)
1 week ago
Jamnagar, India Crest Data Full timeHiring Sr. Site Reliability Engineer (Network) L2 | CCNA Certified Experience - 5+ Years Location - Ahmedabad Certifications Required - CCNA / CCNP Certified Network Engineering: - Complex Operations: Can manage and optimize complex network environments, including large-scale deployments and high-availability systems. - Advanced Troubleshooting: Proficient...
-
Senior Data Analysts
3 weeks ago
Jamnagar, India Invictus Full time🚀 We’re Hiring – Senior Data Analysts & Data Analytics Lead / Manager📍 Location: Chennai (Work from Office) 💼 Experience: 4–8 YearsInvictus is expanding its Data Analytics team and we’re looking for talented professionals who are passionate about transforming data into meaningful business insights.Open Positions2 Senior Data Analysts (4–6...
-
Senior AI Engineer
4 weeks ago
Jamnagar, India Kanerika Inc Full timeWe are seeking an experienced Senior AI Engineer to join our dynamic team, driving innovation in AI-driven solutions with a global impact. This role is specifically tailored for a highly motivated professional with a strong technical background in Python and Java, hands-on expertise in developing Retrieval-Augmented Generation (RAG)-based chatbots, Machine...
-
Data Engineer
2 weeks ago
Jamnagar, India Whatjobs IN C2 Full timeOrganization Description: Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-knotted and hand-woven rugs made using 2500 years old traditional art forms. The founder, Mr. Nand Kishore Chaudhary created a unique...
