Data engineer
2 weeks ago
At Minutes to Seconds, we match people having great skills with tailor-fitted jobs to achieve well-deserved success We know how to match people to the right job roles to create that perfect fit. This changes the dynamics of business success and catalyzes the growth of individuals. We’re passionate about doing an incredible job for our clients and job seekers. Our success is determined by the success of individuals at the workplace. About the job: This is a remote position based in India (100% Remote). The primary goal of this role is Data Ingestion into Snowflake, CI/CD into Snowflake. Other details are as follow: We are responsible for the Platform … all the tooling integrations, security, access-control, data classification/management, orchestration, self-service “lab” concept, observability, reliability … as well as data availability (data ingestion) We are NOT responsible for – Data Modeling, Data Warehousing, Reporting (Power BI) … although we do work with PBI team for access control from PBI to Snowflake. Everything we do is achieved through code – nothing is manual (or Click Ops) – everything is automated – through the effectiveness of our CI/CD framework – Git Hub, Git Hub-Actions, Terraform, Python. Orchestration is centrally managed using Managed Airflow We manage RBAC / Access Control We’re responsible for Tooling Integrations and all the connectivity and authentication requirements · Ingestion Methods/Patterns o Fivetran o Snowflake-Snowpipe (File-Based sources) o Snowflake-Secure Data Share · Solid Software Development (Full SDLC) Experience with excellent Coding skills: o Python (required). o Good knowledge of Git and Git Hub (required) o Good code-management experience/best practices (required). · Understanding of CI/CD to automate and improve the efficiency, speed, and reliability of software delivery. Best Practices/principals Github Actions automate workflows directly from their Git Hub repositories. Automation of building, testing, and deploying code – inc. code linting, security scanning, and version management. Experience with testing frameworks Good knowledge of Ia C (Infrastructure as Code) using Terraform (required) EVERYTHING we do is Ia C Strong verbal and written skills are a must, ideally with the ability to communicate in both technical and some business language A good level of experience with cloud technologies – AWS - namely S3, Lambda, SQS, SNS, API Gateway (API Development), Networking (VPCs), Private Link and Secrets Manager. Extensive hands-on experience engineering data pipelines and a solid understanding of the full data supply chain, from discovery & analysis, data ingestion, processing & transformation, to consumption/downstream data-integration. · A passion for continuous improvement and learning , for optimization both in terms of cost and efficiency, as well as ways of working. Obsessed with data observability (aka data reconciliation), ensuring pipeline and data integrity. Experience working with large structured/semi-structured datasets A good understanding of Parquet, Avro, JSON/XML Experience with Apache Airflow / MWAA or similar orchestration tooling. Experience with Snowflake as a Data Platform Solid understanding of Snowflake Architecture – compute, storage, partitioning etc. Key features - such as COPY-INTO, Snowpipe, object-level tagging and masking policies RBAC (security model) – design and administration – intermediate skill required o query performance tuning, and zero copy clone – nice to have o virtual warehouse (compute) sizing TSQL experience – ability to understand complex queries and think about optimisation - advantageous Data Modelling experience – advantageous Exposure to dbt (data build tool) for data transformations – advantageous Exposure to Alation or other Enterprise Metadata Management (EMM) tooling – advantageous Documentation : architectural designs, operational procedures, and platform configurations to ensure smooth onboarding and troubleshooting for team members. Please send resume at
-
Lead Data Engineer
6 days ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Lead Data Engineer
6 days ago
India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
AWS Data Engineer
2 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
2 weeks ago
india ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
2 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
Lead Data Engineer: Strategic Data Architect
6 days ago
India Wavicle Data Solutions Full timeWavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
india Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Technical Lead
2 months ago
india Data Axle India Full timeData Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...
-
Lead Data Scientist
2 months ago
india Data Axle India Full timeAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...
-
Lead Data Scientist
2 months ago
india Data Axle India Full timeAbout Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...
-
Data engineer
4 weeks ago
India Ryden Global Full timeWe're #hiring #Data Engineers for our USA based client at offshore in India (must support afternoon shift in IST). Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics...
-
Data Engineer
4 weeks ago
India Implere Technolgies Pvt Ltd Full timeRole Description This is a full-time remote role for a Data Engineer at Implere Technologies Pvt Ltd. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics on a day-to-day basis. Qualifications Data Engineering and Data Modeling skills Experience in ETL (Extract...
-
Data Engineer
4 weeks ago
india Implere Technolgies Pvt Ltd Full timeRole DescriptionThis is a full-time remote role for a Data Engineer at Implere Technologies Pvt Ltd. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics on a day-to-day basis.QualificationsData Engineering and Data Modeling skillsExperience in ETL (Extract Transform...
-
Data Engineer
1 month ago
india Ryden Global Full timeWe're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST). Role DescriptionThis is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...
-
Data Engineer
4 weeks ago
India Ryden Global Full timeWe're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST). Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...
-
Data Engineer
4 weeks ago
India Implere Technolgies Pvt Ltd Full timeRole DescriptionThis is a full-time remote role for a Data Engineer at Implere Technologies Pvt Ltd. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics on a day-to-day basis.QualificationsData Engineering and Data Modeling skillsExperience in ETL (Extract Transform...
