Data Engineer
4 weeks ago
JD - Python and Snowflake
- Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems.
- Responsible for Cloud migrations for data pipelines using AWS and Snowflake
- Participate in all aspects of the software development lifecycle for AWS and Snowflake solutions, including planning, requirements, development, testing, and quality assurance
- Work in tandem with our engineering team to identify and implement the most optimal cloud-based solutions.
- Troubleshoot incidents, identify root causes, fix and document problems, and implement preventive measures.
- Working experience on Snowflake Platform
- Working Cloud knowledge on AWS (Certification preferred)
- Working Snowflake knowledge with Designing data warehouses
- Strong hands-on experience in Python with ETL concepts
- Good understanding on Metadata and data lineage
- Able to demonstrate experience with software engineering practices including CI/CD, Automated testing and Performance Engineering.
- Good understanding and exposure on any Git, Bamboo, Confluence and Jira.
- Good problem solving and troubleshooting skills.
Soft skills:
- Team player, collaborative approach and excellent communication skills
- Candidate should be good in communication and articulation
-
Python Data Engineer
4 weeks ago
Bangalore/Hyderabad/Pune/Mumbai/Chennai, IN Swift Strategic Staff Solutions INC Full timeJob Description :We are seeking a talented and experienced Python Data Engineer to join our data team and play a crucial role in building, maintaining, and optimizing data pipelines for our cloud-based data warehouse.Responsibilities :- Design, develop, and implement data pipelines for ingesting, transforming, and loading data into Snowflake using Python...
-
Data Engineer
4 weeks ago
Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full timePosition Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...
-
Data Engineer
4 weeks ago
Mumbai/Bangalore/Chennai/Pune, IN LanceTech Solutions Full timeData Engineer - SQL, PLSQL, Snowflake, ETLWe're seeking an experienced Data Engineer with expertise in SQL, strong PLSQL skills, Snowflake, and ETL development. As a key member of our team, you'll design and implement data-driven solutions, collaborating with software developers, database architects, and data scientists. Your role involves building...
-
AWS Data Engineer
4 days ago
Bangalore/Pune, IN Technomech Placements Full timeThis is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...
-
CGI - Data Engineer - Data Pipeline
4 weeks ago
Bangalore/Hyderabad/Chennai/Pune, IN CGI Information Systems and Management Consultants Full timeRequired Skills :- 5+ years of experience in database administration duties- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline- Experience in building or maintaining ETL processes.- Experienced in working with big data analytics tools.- Need to be proficient in various database types and...
-
Big Data Engineer
4 weeks ago
Bangalore/Chennai/Pune, IN ADVANSOFT Full timeWe are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like...
-
Data Engineer
4 weeks ago
Pune/Bangalore/Chennai, IN ADVANSOFT Full timeSkills :- Hadoop- Python- Spark- PySpark- ETL (Extract, Transform, Load)Roles & Responsibilities :- Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.- Data Processing: Utilize Python and Spark to process and transform large volumes of data efficiently, ensuring scalability and...
-
Azure Data Engineer
4 weeks ago
Chennai/Pune/Mumbai/Bangalore/Coimbatore/Ahmedabad, IN CHAITANYA PLACEMENT Full timeCompany Name : MNCPosition : Permanent (Hybrid)Job Location : Notice Period : Immediate preferredWe are seeking a talented Azure Data Factory Developer to join our team. The ideal candidate will have extensive experience in data engineering and a strong background in developing data pipelines using Azure Data Factory. This individual will be responsible for...
-
AI/ML Engineer
4 weeks ago
Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full timeSummary :We are seeking a talented and passionate AI/Machine Learning Engineer to join our team. You will play a key role in the entire lifecycle of machine learning projects, from data engineering and classical machine learning to potentially exploring deep learning and natural language processing techniques. Your strong foundation in Python coding,...
-
Lead Data Engineer
1 week ago
Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full timeWe are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...
-
Data Engineer
4 weeks ago
Bangalore/Pune, IN vipsa solutions Full timeSALARY : 15LPA - Engineer:Location: Pune, BangaloreExperience: 6-9 yearsNP: Immediate- 15 daysKey accountabilities:As a Data Engineer you will be accountable for:- Understanding operational needs by collaborating with specialized teams- Supporting key, involves architecture designing, building and deploying data systems, pipelines etc- Build agile, scalable,...
-
Data Engineer
4 weeks ago
Bangalore/Pune, IN Gethyr Full timeWe are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...
-
Data Engineer
4 weeks ago
Chennai/Mumbai/Pune, IN iMind Your Business Solutions Private Limited Full timeCompany Description :iMind Business Consulting Inc. is a strategy and talent consulting company headquartered in the US with offices in the UK, US and India. Role Description :This is a full-time hybrid role for one of our niche clients headquartered in San Francisco, US, with offices in India. Leaders in analytics and cloud applications, headquartered in...
-
AWS Data Engineer
4 weeks ago
Bangalore/Pune/Chennai, IN Change leaders Full timeJob Description : AWS Glue + Python PysparkJob Overview :- Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.- This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...
-
Data Engineer
4 weeks ago
Bangalore/Chennai/Hyderabad, IN Cortex Consulting Pvt. Ltd. Full timeResponsibilities :- Design, construct, install, test, and maintain highly scalable data management systems.- Develop and implement ETL processes to collect, store, and process data from various sources.- Build and optimize data pipelines for efficient data ingestion and transformation.- Collaborate with data analysts and data scientists to understand data...
-
Senior Big Data Engineer
4 weeks ago
Bangalore/Pune, IN Recrud Full timeSenior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...
-
Data Engineer
4 days ago
Bangalore/Pune, IN OptOut Full timeRole Description :- Data modeling and architecture : You would be responsible for designing and implementing data models that are optimized for Azure services, including Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.- ETL and data integration: You would be responsible for building and maintaining data pipelines that move data from various...
-
Data Engineer
22 hours ago
Hyderabad/Chennai/Pune, IN Freelancer HR Full timeDescription :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...
-
Data Engineer
4 weeks ago
Bangalore/Mumbai/Pune/Chennai/Kolkata/Noida, IN Change leaders Full timePrimary Skill : - GCP + Python + SQLOR- GCP + Java + SQLNP : Immediate to 35 Days maxJob Location : Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida- Bachelor's degree in computer science or a related discipline- 6+ years of applicable engineering experience- Experience in GCP, Big Query- Strong proficiency in Python with an emphasis in...
-
Indiglobe IT Solutions
4 weeks ago
Bangalore/Pune/Chennai, IN Indiglobe IT Solutions Pvt. Ltd. Full timeAbout the jobSkills : Azure, Azure SQL, Azure SynapseWork type: Full-timeMode of Work: Hybrid (3 days WFO)Notice Period: Max 30 daysMust To Have Skills :- Azure with SQL (Azure SQL) combination is a must to have SSIS SSRS with Azure - SQL with Azure is what you need to look at.Qualifications :- Experience in ETL & Data Warehousing- Should have excellent...