Senior Data Engineer
4 weeks ago
Senior Data Engineer
Onsite : Mumbai/Chennai
About the Role :
- This role is more focused on Pyspark with Cloud developer.
About the Responsibilities :
- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled architecture.
- Developer performs software design and development requiring interaction with system architects and other development team members; and the interaction with business analysts and/or end-users/customers to translate their requests into solutions.
About the Requirements :
Overall Work Experience - 8+ Skill Set :
- Apache spark, Python, Databricks, SQL/NoSQL-Knowledge
- BS Engineering/Computer Science or equivalent experience required.
- Strong analytical skills, Communication, Problem Solving skills.
- Expertise on SQL, Unix.
- Strong hold on Data Manipulation Language, ETL concepts.
- Must have adequate knowledge on - PreData processing, Facts and Dimension, Data Profiling, using any ETL tool or scripting languages- Talend, Informatica, IBM DataStage, Pentaho or using Bigdata concepts. If not used tool must have Python knowledge.
- Expertise in Cloud (prefer Azure), Pyspark.
- Prior experience on Cloud tools like - Data Bricks, Data Factory or equivalent AWS or Azure tools.
- Good Knowledge on PySpark with basic terraform knowledge.
- Expected knowledge of software development methodologies (e.g., Agile, Waterfall).
- Good Problem Solving and Requirement understanding skills as well as a positive attitude, ability, and desires to learn new processes and technologies.
- Successfully implement end to end development and help with Code Reviews, Best practices.
Good to have :
- Azure Knowledge (ref:hirist.tech)
-
Senior Data Engineer
4 weeks ago
Bangalore/Trivandrum/Thiruvananthapuram/Chennai/Pune, IN Arting Digital Full timeSenior Data EngineerExperience : 6y+ Location : Trivandrum, Chennai, Pune, Bangalore Budget : 15 - 25 LPA Work Mode : On-SiteSkills : - Ataccama, Syndigo, Snowflake, Databricks- Requirements :- 6+ Years experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutions- Programming experience in Scala or Python, SQL-...
-
Senior Data Engineer
4 weeks ago
Bangalore/Chennai/Madurai, IN Resourcetree Full timeJob Description : As a Senior MDM Data Engineer with hands-on experience in Informatica Cloud MDM, you will be responsible for leading and executing end-to-end master data management (MDM) initiatives within our organization. Leveraging your deep technical expertise and practical experience, you will drive the design, implementation, and optimization of MDM...
-
Senior Data Engineer- Spark/Python
4 weeks ago
Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full timeWe are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...
-
Senior Cloud Data Engineer
4 weeks ago
Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full timeSenior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...
-
Decision Point
4 weeks ago
Chennai/Gurgaon/Gurugram, IN Decision Point Full timeWhat would a typical day at your work be like?The Person will work as a Senior Data Engineer in Data Engineering team of Decision Point, Translating business and functional user requirements into functioning solutions. The incumbent for the position is expected to deliver but not limited to on following responsibilities :- Set up processes for data...
-
Senior Data Engineer
4 weeks ago
Hyderabad/Chennai/Pune/Mumbai/Gurgaon/Gurugram, IN Hub Work Full timeWe are looking for a data engineer who has experience in building data pipelines for large data platforms. This role will be working with a team building a large data platform catering to the needs of a wealth manager for their application and analytics needs. This role will be augmented with a customer of Intellect and other third parties in delivering...
-
Python Data Engineer
4 weeks ago
Bangalore/Hyderabad/Pune/Mumbai/Chennai, IN Swift Strategic Staff Solutions INC Full timeJob Description :We are seeking a talented and experienced Python Data Engineer to join our data team and play a crucial role in building, maintaining, and optimizing data pipelines for our cloud-based data warehouse.Responsibilities :- Design, develop, and implement data pipelines for ingesting, transforming, and loading data into Snowflake using Python...
-
Senior Data Scientist
4 weeks ago
Gurgaon/Gurugram/Mumbai, IN Invokhr Full timePosition: Senior Data ScientistDesired Experience: 8+ yearsYour team :You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients. You will collaboratively work with interdisciplinary scientists, IT and engineering professionals across the organization to solve critical problems and...
-
Data Engineer
4 weeks ago
Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full timePosition Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...
-
Senior Data Science Engineer
4 weeks ago
Bangalore/Delhi NCR/Chennai/Hyderabad/Mumbai, IN Grizmo Labs Full timeJob Description : We are looking for : - 6-8 years of overall experience and 4 yrs or more into Data Science projects, ML Engineering and Modelling- Hands on experience with Python programming and managing the environment for python projects. - Implementation experience of algorithm categories like Classification, Regression, Parametric and Non-Parametric...
-
Senior Data Engineer
4 weeks ago
Bangalore/Hyderabad/Mumbai/Pune, IN MLOPS SOLUTIONS PRIVATE LIMITED Full timeJob Description :Primary skillset :Experience working with distributed technology tools for developing Batch and Streaming pipelines using :- SQL, Spark, PySpark - Airflow - Spark with Scala .(optional)- Able to write code which is optimized for performance.- Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming...
-
Senior Data Engineer
4 weeks ago
Chennai/Bangalore/Hyderabad/Pune, IN Resourcetree Full timeJob Description :Data engineering role requires creating and managing technological infrastructure of a data platform, be in- charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.Role...
-
Data Engineer
4 weeks ago
Mumbai/Chennai/Pune/Bangalore, IN Coders Brain Pvt Ltd Full timeJD - Python and Snowflake- Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems.- Responsible for Cloud migrations for data pipelines using AWS and Snowflake- Participate in all aspects of the software development lifecycle for AWS and Snowflake solutions, including planning,...
-
Data Engineer
4 weeks ago
Chennai/Mumbai/Pune, IN iMind Your Business Solutions Private Limited Full timeCompany Description :iMind Business Consulting Inc. is a strategy and talent consulting company headquartered in the US with offices in the UK, US and India. Role Description :This is a full-time hybrid role for one of our niche clients headquartered in San Francisco, US, with offices in India. Leaders in analytics and cloud applications, headquartered in...
-
Manager/Senior Manager
4 weeks ago
Delhi NCR/Mumbai/Pune/Bangalore, IN Huquo Consulting Full timeJob Description :Key Responsibilities & Skillsets : Common Skillsets :- 3+ years of experience in Data Engineering : SQL(MySQL preferred), DWH (Redshift or Snowflake), Python and associated data engineering jobs.- Good to have working experience on RESTful API frameworks (Flask/FastAPI)- Experience with AWS core technologies Lambda, S3, ECS(Fargate), IAM,...
-
Optisol Business Solutions
4 weeks ago
Chennai/Madurai/Coimbatore, IN Optisol Business Solutions Full timePosition : Data Engineer( Senior/Lead)Experience : 4-10 yrs.Locations : : Immediate -15 Days (Preferred)Required Candidate Profile :As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsible for assisting in the end-to-end analysis, development &...
-
Senior Data Scientist
4 days ago
Bangalore/Hyderabad/Chennai/Pune, IN Nilasu consulting Full timeAbout the Role :We are searching for a talented and experienced Senior Data Scientist to join our team and play a key role in leveraging the power of machine learning (ML) and artificial intelligence (AI) to extract valuable insights from data. In this role, you will be responsible for the entire data science lifecycle, from data acquisition and wrangling to...
-
AWS Data Engineer
4 weeks ago
Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full timeJob Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...
-
Data Engineer
22 hours ago
Hyderabad/Chennai/Pune, IN Freelancer HR Full timeDescription :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...
-
Data Engineer
4 weeks ago
Bangalore/Chennai/Hyderabad, IN Cortex Consulting Pvt. Ltd. Full timeResponsibilities :- Design, construct, install, test, and maintain highly scalable data management systems.- Develop and implement ETL processes to collect, store, and process data from various sources.- Build and optimize data pipelines for efficient data ingestion and transformation.- Collaborate with data analysts and data scientists to understand data...