Data engineer

mportant Note (Please Read Before Applying) ???? Do NOT apply if: You have less than 5, GCP and Python experience is a plus. You do not have Expertise in Big Query, Gcp Functions highly experience. You are on a notice period longer than 15 days. You are looking for remote only (role is hybrid in Hyderabad / ). You are a fresher or from unrelated backgrounds (e.g., Java-only, Testing-only, Support). ✅ Apply ONLY if you meet ALL criteria above. Random / irrelevant applications will not be processed. Job Title: Data Engineer Location: Hyderabad Experience: Years 5+ (STRICTLY) Employment Type: Permanent Notice Period: Immediate Joiners / About the Company Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future. Job Description; Key Responsibilities: ● Design, develop, test, and maintain scalable ETL data pipelines using Python. ● Work extensively on Google Cloud Platform (GCP) services such as: ○ Dataflow for real-time and batch data processing ○ Cloud Functions for lightweight serverless compute ○ Big Query for data warehousing and analytics ○ Cloud Composer for orchestration of data workflows (based on Apache Airflow) ○ Google Cloud Storage (GCS) for managing data at scale ○ IAM for access control and security ○ Cloud Run for containerized applications Should have experience in the following areas : ○ API framework: Python Fast API ○ Processing engine: Apache Spark ○ Messaging and streaming data processing : Kafka ○ Storage: Mongo DB, Redis/Bigtable ○ Orchestration: Airflow ● Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery. ● Implement and enforce data quality checks, validation rules, and monitoring. ● Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficiedata solutions. ● Manage version control using Git Hub and participate in CI/CD pipeline deployments for data projects. ● Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or Postgre SQL. ● Document pipeline designs, data flow diagrams, and operational support procedures. Required Skills: ● 5 years of hands-on experience in Python for backend or data engineering projects. ● Strong understanding and working experience with GCP cloud services (especially Dataflow, Big Query, Cloud Functions, Cloud Composer, etc.). ● Solid understanding of data pipeline architecture, data integration, and transformation techniques. ● Experience in working with version control systems like Git Hub and knowledge of CI/CD practices. ● Experience in Apache Spark, Kafka, Redis, Fast APIs, Airflow, GCP Composer DAGs. ● Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, Postgre SQL, etc.). ● Experience in data migrations from on-premise data sources to Cloud platforms. Good to Have (Optional Skills): ● Experience working with Snowflake cloud data platform. ● Experience in deployments in GKE, Cloud Run. ● Hands-on knowledge of Databricks for big data processing and analytics. ● Familiarity with Azure Data Factory (ADF) and other Azure data engineering tools. Additional Details: ● Excellent problem-solving and analytical skills. ● Strong communication skills and ability to collaborate in a team environment