Senior Data Engineer
1 week ago
Senior Data Engineer
Location: Chennai (Onsite)
Role Description
The Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large datasets.
Qualifications
- Data Engineering and Data Modeling skills
- Experience with Extract Transform Load (ETL) pipelines
- Expertise in implementing data warehousing solutions
- Analytical skills for performing data analytics on large datasets
- Strong programming skills in languages like Python, Java, or Scala
- Experience with Big Data and cloud-based technologies like Hadoop, Spark, and AWS
- Understanding of data governance and security principles
- Bachelor's degree in Computer Science, Information Systems, or related field
- Strong communication skills and ability to work independently and collaboratively
Experience Required: 6+ years in Data Engineering or related field
Primary Capabilities:
SQL Expertise:
- Proficiency in writing complex SQL queries.
- Experience with database design and optimization.
- Ability to perform data manipulation and analysis.
Databricks Experience:
- Hands-on experience with Databricks platform.
- Familiarity with Databricks' integration with various data sources and sinks.
- Experience in building and optimizing big data pipelines using Databricks.
PySpark Proficiency:
- Strong skills in PySpark for large-scale data processing.
- Understanding of PySpark's architecture and its application in data processing and transformation tasks.
- Ability to write efficient, scalable, and reusable code in PySpark.
Python Programming:
- Strong programming skills in Python.
- Experience with Python libraries relevant to data engineering (e.g., Pandas, NumPy).
- Ability to write clean, maintainable, and efficient code in Python.
AWS Experience:
- Knowledge of AWS services relevant to data engineering (e.g., S3, Lambda, CodeCommit, etc.,).
- Knowledge in building and maintaining data infrastructures on AWS.
- Understanding of cloud computing concepts and how they apply to data engineering tasks.
Analytics Skills:
- Ability to derive insights from large datasets.
- Knowledge of data visualization tools and techniques.
- Proficiency in statistical analysis and using data to inform decisions.
Logical Thinking and Problem-Solving:
- Strong logical reasoning and analytical skills.
- Proven ability to troubleshoot and solve complex problems.
- Capacity to break down and simplify complex problems, developing practical, efficient solutions.
Other Desirable Qualifications:
- Bachelors or Master's degree in Computer Science, Engineering, or a related field.
- Good communication skills and the ability to work collaboratively in a team.
- Experience with version control tools like Git, CodeCommit.
- Familiarity with Agile methodologies and DevOps practices.
- Certification in relevant technologies (e.g., Databricks, AWS Certified Data Analytics) is a plus.
-
Senior Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India AABM Cloud Data Solution Full timeSenior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - 8+ years Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.
-
Senior Data Consultant
4 days ago
Chennai, Tamil Nadu, India Eucloid Data Solutions Full timeWe are looking for a high-energy individual for the role of Senior Data Consultant at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team.The candidate is expected to lead following work-streams:• Drive client meetings with data-driven insights and observations on key website/app metricsfor Upper...
-
Senior GenAI Engineers
23 minutes ago
Chennai, Tamil Nadu, India NTT DATA Full timeReq ID: 341063NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior GenAI Engineers to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Key Responsibilities Design &...
-
Senior Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India iAgami Full timeWe're Hiring – Senior Data Engineer (GCP) Are you passionate about building data platforms that process billions of transactions and drive real-time decisions? Join our growing team atiAgamiTechnologies, where innovation meets data engineering excellence. Location: Chennai / Trichy (Remote) Role: Senior Data Engineer Experience: 5+ years Type: Full-time...
-
Senior Data Engineer
7 days ago
Chennai, Tamil Nadu, India RapidBrains Full timeJob Title:Senior Data Engineer – ODILocation:ChennaiJob Type:ContractExperience :5.5+ YearsWe are seeking a highly skilled Senior Data Engineer with hands-on experience in Oracle Data Integrator (ODI) and enterprise data integration technologies. The ideal candidate will design, build, and optimize scalable data pipelines supporting advanced analytics and...
-
Senior Engineer
1 week ago
Chennai, Tamil Nadu, India NTT DATA Full time ₹ 4,00,000 - ₹ 12,00,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Security...
-
Senior Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India DataPattern Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob Title: Senior Data Engineer (Databricks Certified)Experience:8+ YearsLocation:ChennaiWork Mode:OnsiteJob Summary:We are seeking a highly skilledSenior Data Engineerwith8+ years of experiencein building scalable data platforms and pipelines. The ideal candidate must beDatabricks Certifiedand possess strong expertise inSpark Streaming, distributed data...
-
Senior Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Prodapt Full timeOverviewProdapt is looking for senior data engineers having 3+ years of experience having hands on expertise on GCP, BQ, Data Pipeline creation & ETL.ResponsibilitiesUnderstanding the requirementsPerforming in-depth analysis on dataSetting up secure data pipelines from ingestion to deliveryIndividual contributorRequirements3- 5 years of experience in Data...
-
Senior Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India InsighTek Global Full time ₹ 9,00,000 - ₹ 12,00,000 per yearPosition nameSenior Data EngineerJob DescriptionAbout the RoleWe are looking for candidates with In-depth knowledge of LLM and Modelling for the Senior Data Engineer
-
Senior AWS Data Engineer
2 days ago
Chennai, Tamil Nadu, India Innovatz Global Full timeCompany DescriptionInnovatz Global is a leading Management Consulting and Technology Services company with headquarters in Malaysia and a strong presence across multiple countries, including the U.S., India, China, and Australia. With over 500 skilled professionals, the company specializes in delivering innovative IT solutions and staffing services to...