Data Engineer
6 days ago
We are seeking a dynamic and highly skilled Data Engineer who has extensive experience building enterprise scale data platforms and lead these foundational efforts.
This role demands someone who not only possesses a profound understanding of the data engineering landscape but is also at the forefront of their game.
The ideal candidate will contribute significantly to platform development with diverse skillset while also being very hands-on coding and actively shaping the future of our data ecosystem.
What We Are Looking For :
Responsibilities :
- As a senior engineer, you will be responsible for ideation, architecture, design and development of new enterprise data platform. You will collaborate with other cloud and security architects to ensure seamless alignment within our overarching technology strategy.
- Architect and design core components with a microservices architecture, abstracting platform, and infrastructure intricacies.
- Create and maintain essential data platform SDKs and libraries, adhering to industry best practices.
- Design and develop connector frameworks and modern connectors to source data from disparate systems both on-prem and cloud.
- Design and optimize data storage, processing, and querying performance for large-scale datasets using industry best practices while keeping costs in check.
- Architect and design the best security patterns and practices
- Design and develop data quality frameworks and processes to ensure the accuracy and reliability of data.
- Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.
- Design and develop advanced analytics and machine learning capabilities on the data platform.
- Design and develop observability and data governance frameworks and practices.
- Stay up to date with the latest data engineering trends, technologies, and best practices.
- Drive the deployment and release cycles, ensuring a robust and scalable platform.
Requirements :
years of proven experience in modern cloud data engineering, broader data landscape experience and exposure and solid software engineering experience.
- Prior experience architecting and building successful enterprise scale data platforms in a green field environment is a must.
- Proficiency in building end to end data platforms and data services in GCP is a must.
- Proficiency in tools and technologies: BigQuery, Cloud Functions, Cloud Run, Dataform, Dataflow, Dataproc, SQL, Python, Airflow, PubSub.
- Experience with Microservices architectures - Kubernetes, Docker and Cloud Run
- Experience building Symantec layers.
- Proficiency in architecting and designing and development experience with batch and real time streaming infrastructure and workloads.
- Solid experience with architecting and implementing metadata management including data catalogues, data lineage, data quality and data observability for big data workflows.
- Hands-on experience with GCP ecosystem and data lakehouse architectures.
- Strong understanding of data modeling, data architecture, and data governance principles.
- Excellent experience with DataOps principles and test automation.
- Excellent experience with observability tooling: Grafana, Datadog.
Nice to have :
- Experience with Data Mesh architecture.
- Experience building Semantic layers for data platforms.
- Experience building scalable IoT architectures
-
Operation Analyst
1 week ago
Remote, India Data Engineer Academy LLP Full time ₹ 6,00,000 - ₹ 12,00,000 per yearJob Title: Operations AnalystLocation: Remote | Experience: 0-1 YearsType: Full-TimeNotice-Immediate JoinerAbout Us: Data Engineering Academy is an edtech startup led by FAANG data engineers. We equip aspiring data professionals with the tools, training, and support to succeed in the tech industry.About the Role:We're looking for a proactive Operations...
-
Senior Azure Data Engineer
9 hours ago
Remote, India Data PlatformExperts Full time ₹ 5,00,000 - ₹ 15,00,000 per yearJob Description:We are looking for a skilled and motivated AI Azure Data Engineer with strong expertise in Microsoft Azure data services. The ideal candidate must have hands-on experience with Databricks or Microsoft Fabric and hold a valid certification in either. You will be responsible for designing, developing, and deploying scalable data pipelines,...
-
Senior Data Engineer
1 week ago
Remote, India AABM Cloud Data Solutions Full time ₹ 20,00,000 per yearSenior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.Job Type: Full-timePay: From ₹2,000,000.00 per yearApplication Question(s):How many years of Python Experience do you have?How many...
-
Gis Data Intern
2 weeks ago
Remote, India Engineer Philosophy Web Services Pvt Ltd Full time**Job Title**: GIS Data Intern (Freshers Welcome) **Company**: Engineer Philosophy Web Services Pvt. Ltd. **Location**: Indore, Madhya Pradesh (Remote) **Job Type**: Internship / Full-time Engineer Philosophy Web Services Pvt. Ltd. is seeking a motivated and detail-oriented **GIS Data Intern** to join our Indore-based team. This internship provides...
-
Expert AI Data Rater
2 days ago
remote, India Welo Data Full timeExpert AI Data Rater, English (India) — Shape Global Digital Ads QualityLocation: Remote – Based in India | Contract: Full-Time, Fixed-Term | Start Date: ASAPAt Welo Data, we're not just rating ads; we're actively defining the future of digital content and AI experiences. As a global leader in localization and data transformation, we operate one of the...
-
Expert AI Data Rater
2 weeks ago
Remote, India Welo Data Full time ₹ 12,00,000 - ₹ 24,00,000 per yearExpert AI Data Rater, English (India) — Shape Global Digital Ads QualityLocation: Remote – Based in India | Contract: Full-Time, Fixed-Term | Start Date: ASAPAt Welo Data, we're not just rating ads; we're actively defining the future of digital content and AI experiences. As a global leader in localization and data transformation, we operate one of the...
-
Expert AI Data Rater
2 weeks ago
Remote, India Welo Data Full timeExpert AI Data Rater, English (India) — Shape Global Digital Ads Quality Location: Remote – Based in India | Contract: Full-Time, Fixed-Term | Start Date: ASAP At Welo Data, we're not just rating ads; we're actively defining the future of digital content and AI experiences. As a global leader in localization and data transformation, we operate one of the...
-
Data Engineer
2 days ago
remote, India Riskonnect Full timeData Engineer – Microsoft Fabric & Advanced Analytics Summary We are seeking a skilled Data Engineer with hands-on experience in Microsoft Fabric and advanced analytics platforms. The ideal candidate will design, optimize, and maintain data models and data pipelines to support reporting, analytics, and data science needs across the enterprise. You will...
-
Data engineer
2 days ago
Remote, India INNONEXIS TECHNOLOGY PRIVATE LIMITED Full time ₹ 4,80,000 - ₹ 6,00,000 per yearWe're Hiring: Freelance Data EngineerWe are looking for a talented Freelance Data Engineer to help us design, build, and optimize scalable data pipelines and platforms. Key Responsibilities:Design, develop, and maintain ETL pipelines and workflowsWork with structured and unstructured data across multiple sourcesImplement and optimize data solutions on AWS...
-
Data Engineer
1 week ago
Remote, India Deltacubes Technologies Full time ₹ 13,20,000 - ₹ 14,40,000 per yearJD(1) for Data Engineer with strong Data Vault 2.0 - Chennai basedImmediate Joiners only· Experience: 6 -8yearsWFO/WFH/ Hybrid· Strong expertise in data transformation and pipeline development (SQL, Python, DBT)· Strong expertise and experience in Data Vault 2.0 modeling framework· IDE-savvy, working with dbt CLI locally and github copilot· Build dbt...