Data Engineer
2 days ago
1. Data Architecture Design Design end-to-end data architectures using Azure services (e.g., Azure Synapse Analytics, Azure Data Lake, Azure SQL Database, Cosmos DB). Define data models, data flows, and integration patterns aligned with business and technical requirements. Ensure solutions support scalability, reliability, and performance goals. 2. Data Integration and ETL/ELT Design and oversee data ingestion pipelines using tools like Azure Data Factory, Synapse Pipelines, or Databricks. Establish processes for data transformation, cleansing, and enrichment. Integrate structured, semi-structured, and unstructured data from multiple sources (on-premises and cloud). 3. Data Storage and Management Choose appropriate storage solutions (e.g., Data Lake Gen2, Blob Storage, SQL, Cosmos DB) based on use cases. Define data retention policies, partitioning strategies, and lifecycle management. Optimize storage performance and cost. 4. Data Governance and Security Implement data governance frameworks, including data lineage, cataloging, and metadata management (e.g., Azure Purview / Microsoft Purview). Ensure compliance with GDPR, HIPAA, and other regulations. Define and implement data security, encryption, and role-based access control (RBAC) in Azure. 5. Analytics and BI Enablement Architect analytical environments for Power BI, Azure Synapse, and Databricks. Enable real-time and batch analytics. Ensure that data is accessible and trustworthy for reporting and machine learning. 6. Collaboration and Stakeholder Management Work with data engineers, analysts, scientists, and business stakeholders to understand data requirements. Translate business goals into technical data strategies. Provide architectural guidance to cross-functional teams. 7. Performance Optimization Monitor and optimize query performance, data pipelines, and storage costs. Implement data partitioning, caching, and indexing strategies. Use Azure Monitor, Log Analytics, and other tools for system health and performance tracking. 8. Cloud Strategy and Best Practices Develop and maintain a data strategy aligned with overall Azure cloud architecture. Stay current on Azure updates and industry trends to recommend improvements. Promote DevOps and CI/CD practices for data pipeline deployment and management. 9. Documentation and Standards Create and maintain architecture diagrams, design documents, and data dictionaries. Define naming conventions, coding standards, and documentation best practices for data teams. 10. Mentorship and Leadership Guide and mentor data engineers and developers in best practices for Azure data solutions. Provide architectural oversight during project execution. Conduct code and design reviews to ensure consistency and quality.
-
Data engineer
1 week ago
Vadodara, India Insight Global Full timeGCP DATA ENGINEER - Contract (Long term) 4–5+ years of experience as a Data Engineer with hands-on support for Google Looker. Strong experience in data modeling and building data marts. Proficiency in ETL/ELT pipeline development and SQL performance tuning. Experience with Look ML and semantic layer design in Looker. Familiarity with healthcare data and...
-
Data Engineer
6 days ago
Vadodara, Gujarat, India Sharedpro Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description :Roles and Responsibilities:Description of Skills/Needs :Duties and Responsibilities Design, build, and deliver efficient data models and products that align with business needs. Understand requirements fully and come up with robust data models and products while developing solutions tailored to analytical and consumption requirements....
-
Data Engineer
2 weeks ago
Vadodara, Gujarat, India Atlas Copco Group Full time ₹ 8,00,000 - ₹ 18,00,000 per yearYour roleAbout UsAtlas Copco is a Swedish multinational industrial company that was founded in 1873 headquartered in Nacka, Sweden. We are world leaders in Compressors, We also manufactur industrial tools and equipments.We are an IT Service Provider company within Atlas Copco Group called Global IT Hub (India). We are also focusing on Digital transformation...
-
Data Engineer-
3 days ago
Vadodara, India MyRemoteTeam Inc Full timeAbout UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Position: Python Coder – Data Processing Client: Wipro (Google Project) Location: Remote –...
-
Data Engineer
4 days ago
Vadodara, Gujarat, India Kiash Solutions LLP Full time ₹ 12,00,000 - ₹ 36,00,000 per year1. Data Architecture Design Design end-to-end data architectures using Azure services (e.g., Azure Synapse Analytics, Azure Data Lake, Azure SQL Database, Cosmos DB). Define data models, data flows, and integration patterns aligned with business and technical requirements. Ensure solutions support scalability, reliability,...
-
Data Engineer
3 weeks ago
Vadodara, India Kanerika Inc Full timeWho we are:Kanerika Inc. is a premier global software products and services firm that specializes in providing innovative solutions and services for data-driven enterprises. Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI. We leverage cutting-edge...
-
Senior Data Engineer
3 weeks ago
Vadodara, India Coffeee.io Full timeJob Title:Lead Data Engineer – SnapLogic Location: Remote Experience: 8+ years (with 3+ years in SnapLogic ETL) Employment Type: Full-timeRole Overview: We are seeking aLead Data Engineer – SnapLogicto design, build, and optimize data integration pipelines across on-premise and cloud platforms. The ideal candidate will have hands-on experience...
-
Data Engineer
5 days ago
vadodara, India Aecor Digital Full timeCompany DescriptionAecor is a UK-based software company empowering businesses worldwide with innovative, reliable, and scalable digital solutions. We partner with startups, SMEs, and large enterprises to design and develop custom software, enterprise applications, SaaS platforms, and cloud-based systems. Our focus on customer-first service, innovation, and...
-
Lead Data Engineer
2 weeks ago
Vadodara, Gujarat, India Asian Hires Full time ₹ 24,00,000 - ₹ 36,00,000 per yearReporting RelationshipPosition Reports To: Senior Manager Application DevelopmentDepartment: Information TechnologyPosition Location: Vadodara, Gujarat, India (Hybrid)Budget: 20,00,000 -30,00,000 PA.Job SummaryWe are seeking a strategic and technically proficient Lead Data Warehouse Engineer to architect, manage, and evolve our enterprise data warehouse....
-
Data Engineer
1 week ago
Vadodara, Gujarat, India Aecor Digital Full time ₹ 5,00,000 - ₹ 12,00,000 per yearCompany DescriptionAecor is a UK-based software company empowering businesses worldwide with innovative, reliable, and scalable digital solutions. We partner with startups, SMEs, and large enterprises to design and develop custom software, enterprise applications, SaaS platforms, and cloud-based systems. Our focus on customer-first service, innovation, and...