Principal/Senior Data Engineer
1 week ago
Location : Remote Position
Duration : 12 Months with possible extension
Employment Type : C2C
Client : Zendesk (They will be working in USA timings EST zone till 2:00 PM, as per India timings working hours will be 2:30 PM to 11:30 PM IST.)
Location preference : PAN India
Skills Needed :
- Data transformation (DBT)
- Data curation
Job Description :
A data curation engineer migrating from GCP to Snowflake with expertise in dbt, GCP, and Snowflake needs strong skills in cloud migration, specifically deprecating GCP services and mapping data to Snowflake. They must be proficient in dbt for building and maintaining transformation models, ensuring data quality and traceability within Snowflake. Additionally, they should excel in automating and optimizing ETL/ELT pipelines to ensure smooth data movement and efficient performance during and after migration.
Key Responsibilities :
- Lead the full migration process of data from Google Cloud Platform (GCP) to Snowflake, ensuring minimal downtime and data integrity.
- Develop, maintain, and optimize dbt models to transform raw data into structured, actionable insights in Snowflake.
- Design and implement automated ETL/ELT pipelines using tools such as Apache Airflow, GCP Dataflow, or similar, for smooth data transfer and transformation.
- Collaborate with data architects and cloud engineers to define the migration strategy, mapping existing GCP services (e.g., BigQuery, Cloud Storage) to Snowflake's architecture.
- Manage the deprecation of GCP infrastructure, ensuring data pipelines are re-architected for Snowflake compatibility.
- Build and maintain data workflows and transformations in dbt, ensuring data quality through comprehensive testing, version control, and documentation.
- Monitor, troubleshoot, and optimize data pipelines and Snowflake performance, ensuring efficient data processing and scalability.
- Ensure compliance with data governance policies, including data lineage tracking, metadata management, and adherence to data privacy regulations (e.g., GDPR, HIPAA).
- Collaborate with cross-functional teams, including data scientists, analysts, and business users, to ensure curated data meets stakeholder requirements.
- Provide technical mentorship to junior team members and contribute to continuous improvement in data engineering processes.
Required Qualifications :
- 5+ years of experience in data engineering, with a strong focus on GCP, Snowflake, and dbt.
- Proven expertise in cloud migration projects, particularly in moving data from GCP to Snowflake.
- Extensive experience with dbt for data transformation, automation, and testing.
- Strong understanding of ETL/ELT pipeline development using tools like Apache Airflow, GCP Dataflow, or similar technologies.
- Proficiency in SQL and experience with cloud-based databases such as BigQuery and Snowflake.
- Experience with data modeling, performance tuning, and pipeline optimization in Snowflake.
- Solid knowledge of data governance, metadata management, and data privacy regulations.
- Excellent problem-solving skills and the ability to troubleshoot and resolve pipeline or performance issues.
- Strong collaboration and communication skills, with experience working in cross-functional teams.
- Ability to manage multiple priorities in a fast-paced environment.
Preferred Qualifications :
- Experience with Snowpipe or other Snowflake-specific tools for data ingestion and transformation.
- Familiarity with version control systems (e.g., Git) and CI/CD processes in a data engineering context.
- Knowledge of Python, Bash, or other scripting languages for automation.
- Experience with big data tools and frameworks (e.g., Hadoop, Spark) is a plus.
-
Principal
1 week ago
Remote, India R k Senior Secondary School Full time**Your updated job posting**: **_Job Title: Principal_** **_School Name:_ R K Senior Secondary School** **_Location:_ Lucknow, Uttar Pradesh** **_Job Type:_ Full-time** **_About Us:_** **R K Senior Secondary School seeks an experienced, visionary leader as Principal.** **_Job Summary:_** **Lead our school community, ensuring academic excellence,...
-
Senior Data Quality Strategist
3 days ago
Remote/Bangalore, India The Principal TAG Full timeAbout The Principal TAGWe are seeking an experienced Senior Data Quality Strategist to lead our COE establishment and centralize all testing artifacts using Jira TTM. The ideal candidate will have 15+ years of QA experience, proficiency in Tosca DI, test case management, and test automation strategies.Estimated Salary: $150,000 - $180,000 per yearJob...
-
Senior Quality Assurance Automation Expert
2 days ago
Remote, India The Principal TAG Full timeAbout the Role: As a Senior Quality Assurance Automation Expert at The Principal TAG, you will have the opportunity to establish and lead our IT Testing Center of Excellence (COE). Responsibilities: - Establish a centralized testing framework using Jira TTM and Tosca DI. - Develop and enforce standardized guidelines for test case design, execution, and...
-
Principal Data Scientist
6 months ago
Remote, India InOrg Global Full time**Job Description: Principal Data Scientist** **About InOrg Global**: InOrg Global helps organizations achieve global competitiveness through seamless integration of talent, technology, and strategic capabilities. As a Global Capability Center Partner to companies of all sizes, from startups to Fortune500s, InOrg Global augments clients capabilities to...
-
Principal Data Science
3 months ago
Remote, India ixceed solutions Full time**Role: Principal Data Science Engineer** **Exp: 10+ Years** **Location: Remote** **Notice Period: 30 Days Max** **Key Responsibilities**: - **Model Development and Implementation**: - Design, develop, and deploy advanced data science models and algorithms. - Ensure models are scalable, maintainable, and optimized for performance. - **Leadership and...
-
Tricentis Tosca Automation Framework Developer
22 hours ago
Remote, India The Principal TAG Full timeJob Description:The Principal TAG is seeking a highly skilled Tricentis Tosca Automation Subject Matter Expert to join our team and contribute to the development and execution of robust test automation frameworks.About the Role:We are looking for an experienced professional with strong knowledge of functional test automation, Tricentis Tosca, PL/SQL, TOSCA...
-
Principal Biostatistician
6 months ago
Remote, India Premier Research Full timePremier Research is looking for a **Principal Biostatistician **to join our **Biostatistics t**eam! You will help biotech, MedTech, and specialty pharma companies transform life-changing ideas and breakthrough science into new medicines, devices, and diagnostics. What we do is profoundly connected to saving and improving lives, and we recognize our team...
-
Principal Architect
1 month ago
Remote, India NewPage Digital Healthcare Solutions Full timeAs a Principal Architect, you will own the integrity and strength of the solutions recommended, leveraging the transformative power of artificial intelligence to elevate our capabilities. You'll act as a trusted advisor to our team and clients, utili **Benefits**: Flexible and remote work Employee-centric culture Supportive peers Work-life balance Generous...
-
Principal Architect
6 months ago
Remote, India DeepHealth Full timeDeepHealth is seeking a highly experienced and motivated Principal Architect for our Cloud PACS (Picture Archiving and Communication System) team. This role is pivotal in designing, developing, and implementing scalable, secure, and efficient cloud-based PACS solutions. The Principal Architect will work closely with cross-functional teams to ensure our...
-
Azure Data Architect
6 months ago
Remote, India Data PlatformExperts Full timeJob Description: Azure Data Engineer (Architect Level) We are seeking an experienced and highly skilled Azure Data Engineer at the Architect level to lead the design and implementation of complex data solutions on the Microsoft Azure platform. As an Azure Data Engineer Architect, you will be responsible for providing technical expertise, guiding the...
-
Principal Clinical SAS Programmer
6 months ago
Remote, India Caidya Full time**Job Title**:Principal** **Clinical SAS Programmer**Job Location**: India (Remote)**Job Overview**: The Principal Clinical SAS Programmer supports the Company’s data operations by providing programming services to Data Management. The Principal Clinical SAS Programmer provides technical and functional expertise in SAS, and where appropriate, mentors and...
-
Azure Data Architect
6 months ago
Remote, India Data PlatformExperts Full time**Job Description: Azure Data Architect** **Key Responsibilities**: - **Design and Implementation**: - Design and implement end-to-end data solutions (data models, pipelines, data lakes, data warehouses) in Azure. - Optimize and maintain existing Azure data structures and integration processes. - Ensure architectural solutions are scalable, maintainable,...
-
Senior Azure Data Engineer
1 week ago
Remote, India Quantumbricks Full timeJob Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have over 10 years of experience in designing, developing, and implementing data solutions on Azure. This role involves working closely with cross-functional teams to build scalable, efficient, and secure data platforms. You...
-
Senior Data Engineer
1 week ago
Remote, India Quantumbricks Full timeJob Summary : We are seeking a highly skilled Senior Data Engineer with over 10 years of experience in designing, developing, and managing robust data pipelines, with specific expertise in Informatica Intelligent Cloud Services (IICS). The ideal candidate will have extensive experience in handling complex ETL/ELT processes, cloud data integration, and data...
-
Senior AWS Data Engineer
1 week ago
Remote, India Quantumbricks Full timeJob Summary. We are seeking a highly skilled and experienced Senior AWS Data Engineer to lead our cloud data architecture, design, and development initiatives. The ideal candidate will have deep expertise in building and managing large-scale data pipelines and solutions on AWS, as well as strong experience in data architecture, ETL, and real-time data...
-
Principal/Senior Analytics Specialist
1 week ago
Anywhere in India/Multiple Locations/Remote BlueByte Technologies Full timePosition : Principal/Senior Analytics SpecialistLocation : Remote PositionDuration : 12 Months with possible extensionEmployment Type : C2CClient : Zendesk (They will be working in USA timings EST zone till 2:00 PM, as per India timings working hours will be 2:30 PM to 11:30 PM IST.)Location preference : PAN India Principal Analytic include :- Inventory of...
-
Data Engineering Expert
2 days ago
Remote, India CodeKart Full timeJob Title: Senior Data Pipeline Developer">About CodeKart:">We are a cutting-edge technology firm dedicated to delivering innovative solutions. Our team is passionate about data engineering and committed to excellence.">Job Overview:">We are seeking an experienced Senior Data Pipeline Developer to join our team. As a key member, you will design, develop, and...
-
Principal Med Writer
6 months ago
Remote, India Thermo Fisher Scientific Full time**Principal Medical Writer (India) (FSP)** At Thermo Fisher Scientific, you will discover meaningful work that makes a positive impact on a global scale. Join our colleagues in bringing our Mission to life - enabling our customers to make the world healthier, cleaner, and safer. We provide our teams with the resources needed to achieve individual career...
-
Data Science
6 months ago
Remote, India Skillety Technologies Full time**Responsibilities**: - Drive development, scaling and execution of ML/AI models for Dell internal business function - Design, develop and program methods, processes and systems to consolidate and analyze structured and unstructured data from multiple sources to generate actionable insights and solutions. - Produce actionable and compelling recommendations...
-
Senior Data Analytics Engineer
1 month ago
Remote/Hyderabad, India CAW Studios Pvt Ltd Full timeJob Title : Senior Data Analytics EngineerReports To : Technical Architect (Data & Analytics)Employment Type : Contract to HireJob Summary :This role requires a skilled data analyst with a strong background in data engineering, analytics development, and administration of data analytics platforms. The candidate will have expertise in Spotfire administration...