Senior Data Engineer
3 weeks ago
About the Role
A "Python Data Engineer" is a technical role focused on designing, building, and maintaining data pipelines using primarily Python programming language to extract, transform, and load (ETL) data from various sources into a usable format for analysis, often working with large datasets and collaborating with data scientists and analysts, while utilizing cloud platforms and data warehousing technologies to ensure efficient data processing and storage.
Key Responsibilities
- Data Pipeline Development: Design and implement robust data pipelines using Python to extract data from different sources (databases, APIs, flat files), transform it as needed, and load it into data warehouses or data lakes.
- ETL Process Automation: Write Python scripts to automate data cleansing, aggregation, and manipulation tasks within ETL pipelines.
- Data Quality Assurance: Develop and implement data quality checks to ensure data accuracy and consistency throughout the pipeline.
- Database Management: Interact with relational and NoSQL databases using SQL queries to retrieve, store, and manage data.
- Cloud Integration: Utilize cloud platforms like AWS, Azure, or GCP to build and manage scalable data infrastructure.
- Big Data Processing: Leverage distributed computing frameworks like Apache Spark to process large volumes of data efficiently.
Required Skills
- Programming Languages: Expert proficiency in Python, including libraries like Pandas, NumPy, and potentially Scikit-learn
- SQL: Strong SQL skills to query and manipulate data in relational databases
- Data Warehousing: Understanding of data warehousing concepts and tools (e.g., Redshift, Snowflake)
- Data Engineering Tools: Familiarity with data pipeline orchestration tools (e.g., Apache Airflow)
- Cloud Computing: Knowledge of cloud platforms (AWS, Azure, GCP) and related data services
Why Work with Us
Opportunity to work with cutting-edge technology in a collaborative and fast-paced environment.
Competitive salary and benefits package.
Work with a team that values innovation, automation, and continuous improvement.
Career growth opportunities in an expanding engineering organization.
-
Senior Data Engineer
1 month ago
Delhi, Delhi, India Luxoft Full timeJob Title: Senior Data Ops EngineerWe are seeking a highly skilled Senior Data Ops Engineer to join our team at Luxoft. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement scalable data collection,...
-
Senior Data Engineer
6 days ago
Delhi, Delhi, India Muoro Full timeJob Title: Senior Data EngineerAbout the Role:We are looking for a skilled Data Engineer to help us build and maintain our data infrastructure. The ideal candidate will have a strong background in data engineering and experience working with AWS data services.Key Responsibilities:Design and build large-scale enterprise data solutions using AWS data...
-
Senior Data Engineer
1 month ago
Delhi, Delhi, India Matrix Full timeJob Title: Senior Data EngineerMatrix is seeking a highly experienced Senior Data Engineer to lead our team responsible for ensuring seamless data integration into the Actimize system. As a key member of our team, you will be responsible for leading and managing database systems and technical business analysis projects, ensuring alignment with organizational...
-
Senior Data Engineer
3 weeks ago
Delhi, Delhi, India TVARIT Full timeAbout UsTVARIT GmbH is a renowned developer of innovative solutions in the field of artificial intelligence (AI) for the manufacturing, automotive, and process industries. Our software products empower our customers to make informed decisions, for instance, in predictive maintenance, OEE optimization, and quality prediction. We have a strong portfolio of...
-
Senior Data Engineer
1 hour ago
Delhi, Delhi, India Interspence Solutions Full timeAbout the Job :Company Overview :We are Interspence Solutions, a leading IT consulting and support services provider in the manufacturing and process industry. We have entered into a long-term contract with a Major US-based Oil & Gas company to provide skilled IT resources and services under their IT leadership team direction.We are transforming our business...
-
Senior Data Engineer
1 month ago
Delhi, Delhi, India FedEx Full timeJob SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at FedEx. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures to support our business operations.Key ResponsibilitiesDesign and develop scalable data pipelines and...
-
Senior Data Engineer
4 weeks ago
Delhi, Delhi, India Mrsool Full timeAbout MrsoolMrsool is a leading on-demand delivery platform in the Middle East and North Africa region, known for its seamless user experience and high ratings on the App Store and Google Play Store.The JobWe are seeking a highly skilled Senior Data Engineer to join our team and help us establish robust foundational data infrastructures. As a key member of...
-
Senior Data Engineering Manager
4 weeks ago
Delhi, Delhi, India Logic Software Solutions Full timeJob Description: Senior Data Engineering ManagerAt Logic Software Solutions, we are seeking an accomplished Senior Data Engineering Manager to lead our data engineering initiatives and drive innovative solutions that align with our strategic business goals.Key Responsibilities:Architecture of Highly Available Distributed Systems: Design and construct...
-
Senior Data Transformation Engineer
4 weeks ago
Delhi, Delhi, India Truelancer Full timeJob Title: Senior ETL QA EngineerJob Description:We are seeking a highly skilled Senior ETL QA Engineer to join our team at Truelancer. As an experienced professional in ETL testing, automation, and performance testing, you will be responsible for ensuring the quality, integrity, and reliability of our ETL processes.Key Responsibilities:* Design and execute...
-
Senior Data Engineer
4 weeks ago
Delhi, Delhi, India Mrsool Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Mrsool. As a key member of our data infrastructure team, you will be responsible for designing and implementing robust data architectures, creating systems for moving and transforming data, and ensuring its accuracy.Key ResponsibilitiesDesign and implement data pipelines...
-
Senior Data Engineer
6 days ago
Delhi, Delhi, India IDinsight Full timeAbout IDinsightIDinsight is a global advisory, data analytics, and research organization that helps leaders in international development maximize their social impact. We tailor a wide range of data and evidence tools to help decision-makers design effective programs and rigorously test what works to support communities.Role OverviewWe are seeking a skilled...
-
Senior Data Engineer
3 weeks ago
Delhi, Delhi, India Cloud Destinations Full timeJob Summary:Cloud Destinations is seeking a highly skilled Data Architect Leader to design, develop, and maintain robust data pipelines and data warehouses. As a Senior Data Engineer, you will play a critical role in extracting, transforming, and loading (ETL) large datasets, analyzing data to uncover insights, and building data products that drive business...
-
Senior Data Engineering Specialist
6 days ago
Delhi, Delhi, India Accolite Full timeAbout AccoliteAccolite is a leading company that requires an experienced professional to take on the role of Senior Data Engineering Specialist.
-
Senior Hadoop Data Engineer
2 weeks ago
Delhi, Delhi, India Tata Consultancy Services Full timeJob Role: Pyspark Hadoop DeveloperAt Tata Consultancy Services, we are seeking a skilled Senior Hadoop Data Engineer to join our team. The ideal candidate will have expertise in designing and developing data engineering platforms, guiding developers, and implementing end-to-end data and business analysis solutions.Key Responsibilities:• Design and develop...
-
Senior Data Engineering Director
6 days ago
Delhi, Delhi, India SourceBae Full timeJob Title: Senior Data Engineering DirectorAbout SourceBae:We are a forward-thinking organization dedicated to harnessing the power of data. Our mission is to drive innovation through cutting-edge technology and expertise.Salary: ₹2500000 - ₹3500000 per annum, depending on experienceJob Description:We are seeking an experienced Senior Data Engineering...
-
Senior Data Engineer GCP
1 month ago
Delhi, Delhi, India Logic Software Solutions Full timeJob Title: Senior Data Engineer (GCP)We are seeking a seasoned Senior Data Engineer to join our team at Logic Software Solutions. As a key member of our data engineering team, you will be responsible for architecting, implementing, and maintaining high-performance data pipelines using GCP services, particularly BigQuery, Cloud Storage, Cloud Functions, and...
-
Senior Big Data Engineer
2 weeks ago
Delhi, Delhi, India Circana Full timeAbout the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team at Circana. The ideal candidate will have a strong background in big data technologies, including Hadoop, Spark, and Scala.Key ResponsibilitiesDesign and develop large-scale data processing systems using Hadoop and Spark.Work with our data engineering team to architect...
-
Senior Security Engineer
2 weeks ago
Delhi, Delhi, India NTT DATA Full timeJob OverviewThe Security Managed Services Engineer (L2) at NTT DATA plays a critical role in ensuring the security and integrity of our clients' infrastructure and systems. As a key member of our managed services team, this individual will be responsible for providing proactive monitoring, identifying, investigating, and resolving technical incidents and...
-
Senior Data Architect
1 month ago
Delhi, Delhi, India Logic Software Solutions Full timeJob Description: Senior Data ArchitectWe are seeking an experienced Senior Data Architect to lead the design and implementation of our data engineering solutions. The ideal candidate will have a strong background in data architecture, cloud computing, and data engineering.Key Responsibilities:Design and implement scalable data architectures on the Google...
-
Senior Infrastructure Architect
2 weeks ago
Delhi, Delhi, India Frontline Data Solutions Full timeAbout Frontline Data SolutionsFrontline Data Solutions is a leading provider of web-based environmental, health, and safety software to the chemical, oil & gas, and manufacturing industries. Our company culture combines the agility of a startup with the stability of a 25-year-old industry leader.Job SummaryWe are seeking an experienced Senior Network...