Senior Data Engineer
1 day ago
Hyderabad, Telangana, India
OSI Digital
Remote
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Job Title: GCP Data Engineer / Solution Architect (Contract)
Engagement Type: Contract, part-time
Duration: 3 months (extension possible)
Experience:
8–10 years Work Mode: Remote / work from home Commitment: 20 hours per week
About The Role
We need a senior data professional on a short-term, part-time contract. You'll combine hands-on data engineering on Google Cloud Platform with solution architecture and business analysis. You'll assess the current state, find gaps, design the target solution and write code where needed, working mostly on your own with our internal team and stakeholders.
Key Responsibilities
• Gather business and technical requirements through stakeholder workshops and turn them into solution designs.
• Do gap analysis between the current-state data landscape and the target-state requirements, then recommend remediation options and a roadmap.
• Define the solution architecture for data ingestion, processing, storage and consumption layers on GCP.
• Design and build scalable data pipelines using BigQuery, Dataflow, Dataproc, Cloud Composer (Airflow), Cloud Storage and Pub/Sub.
• Write production-quality code in Python, PySpark and SQL for data transformation, data quality checks and automation.
• Design data models (dimensional, data vault or lakehouse patterns) and optimize BigQuery performance and cost.
• Prepare architecture diagrams, design documents, gap analysis reports and handover documentation.
• Review code and designs, and advise the internal team on best practices for GCP data engineering.
• Report progress, risks and dependencies to project stakeholders regularly. Required Skills & Qualifications
• 8–10 years of experience in data engineering, data platforms or analytics, with at least 4 years of hands-on work on GCP.
• Strong experience with GCP data services: BigQuery, Dataflow, Dataproc, Cloud Composer, Cloud Storage, Pub/Sub, IAM.
• Expert-level Python and SQL, with solid hands-on experience in PySpark.
• Proven solution architecture
experience:
designing end-to-end data platforms, integration patterns and non-functional requirements (security, scalability, cost).
• Strong business analysis
skills:
requirement elicitation, process mapping, BRDs/FRDs and gap analysis.
• Experience with CI/CD, Git and infrastructure-as-code (Terraform preferred).
• Excellent communication and documentation skills; comfortable working with both business and technical stakeholders.
• Self-driven and able to deliver independently in a remote, part-time setting. Good to Have
• Google Cloud Professional Data Engineer or Professional Cloud Architect certification.
• Exposure to other cloud platforms (AWS, Azure) or to Snowflake or Databricks.
• Experience with data governance tools (Dataplex, Data Catalog) and data quality frameworks.
• Domain experience in BFSI, aviation, telecom or the public sector.
Experience:
8–10 years Work Mode: Remote / work from home Commitment: 20 hours per week
About The Role
We need a senior data professional on a short-term, part-time contract. You'll combine hands-on data engineering on Google Cloud Platform with solution architecture and business analysis. You'll assess the current state, find gaps, design the target solution and write code where needed, working mostly on your own with our internal team and stakeholders.
Key Responsibilities
• Gather business and technical requirements through stakeholder workshops and turn them into solution designs.
• Do gap analysis between the current-state data landscape and the target-state requirements, then recommend remediation options and a roadmap.
• Define the solution architecture for data ingestion, processing, storage and consumption layers on GCP.
• Design and build scalable data pipelines using BigQuery, Dataflow, Dataproc, Cloud Composer (Airflow), Cloud Storage and Pub/Sub.
• Write production-quality code in Python, PySpark and SQL for data transformation, data quality checks and automation.
• Design data models (dimensional, data vault or lakehouse patterns) and optimize BigQuery performance and cost.
• Prepare architecture diagrams, design documents, gap analysis reports and handover documentation.
• Review code and designs, and advise the internal team on best practices for GCP data engineering.
• Report progress, risks and dependencies to project stakeholders regularly. Required Skills & Qualifications
• 8–10 years of experience in data engineering, data platforms or analytics, with at least 4 years of hands-on work on GCP.
• Strong experience with GCP data services: BigQuery, Dataflow, Dataproc, Cloud Composer, Cloud Storage, Pub/Sub, IAM.
• Expert-level Python and SQL, with solid hands-on experience in PySpark.
• Proven solution architecture
experience:
designing end-to-end data platforms, integration patterns and non-functional requirements (security, scalability, cost).
• Strong business analysis
skills:
requirement elicitation, process mapping, BRDs/FRDs and gap analysis.
• Experience with CI/CD, Git and infrastructure-as-code (Terraform preferred).
• Excellent communication and documentation skills; comfortable working with both business and technical stakeholders.
• Self-driven and able to deliver independently in a remote, part-time setting. Good to Have
• Google Cloud Professional Data Engineer or Professional Cloud Architect certification.
• Exposure to other cloud platforms (AWS, Azure) or to Snowflake or Databricks.
• Experience with data governance tools (Dataplex, Data Catalog) and data quality frameworks.
• Domain experience in BFSI, aviation, telecom or the public sector.