Data Engineer

4 weeks ago

Hyderabad, India Witlance Solutions Pvt. Ltd. Full time

Position : Data Engineer

Experience : 5+ Years

Location : Hyderabad

Job Overview :

We are seeking an experienced Python Developer with expertise in PySpark and AWS to join our dynamic team. The ideal candidate will have over 5 years of experience in software development, with a strong focus on data engineering and cloud-based solutions. The candidate should be a self-starter, capable of working independently as an individual contributor, and possess excellent communication skills to collaborate effectively with various stakeholders.

Key Responsibilities :


- Design, develop, and maintain scalable data processing pipelines using PySpark.


- Implement and optimize ETL (Extract, Transform, Load) processes to handle large volumes of data.


- Develop, test, and deploy cloud-based solutions on AWS, leveraging services such as S3, Lambda, EMR, Glue, and Redshift.


- Write clean, maintainable, and efficient code in Python, following best practices.


- Collaborate with cross-functional teams, including data scientists, data analysts, and DevOps, to deliver high-quality software solutions.


- Perform data validation, transformation, and cleansing tasks to ensure data integrity and accuracy.


- Optimize data storage and retrieval strategies to improve performance and reduce costs.


- Troubleshoot and resolve issues related to data processing, cloud infrastructure, and software bugs.


- Contribute to the continuous improvement of development processes and tools.


- Communicate effectively with team members, project managers, and other stakeholders to provide updates and clarify Skills and Qualifications :


- Bachelor's degree in Computer Science, Engineering, or a related field.


- 5+ years of professional experience in Python development.


- Strong experience with PySpark for big data processing.


- Proficiency in AWS services such as S3, Lambda, EMR, Glue, and Redshift.


- Familiarity with data warehousing concepts and ETL frameworks.


- Experience with version control systems like Git.


- Knowledge of SQL and experience with relational databases.


- Excellent problem-solving skills and attention to detail.


- Ability to work independently as well as in a team environment.


- Strong communication skills, both written and verbal.


Preferred Qualifications :


- Experience with containerization technologies such as Docker and Kubernetes.


- Familiarity with CI/CD pipelines and DevOps practices.


- Knowledge of data visualization tools like Tableau or Power BI.


- Knowledge in other big data technologies such as Hadoop, Kafka, or Spark Streaming.


(ref:hirist.tech)

  • Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India data Full time

    Job DescriptionAbout the RoleWe are seeking a highly skilled Data Analyst to join our team at data.ai. As a Data Analyst, you will be responsible for analyzing, monitoring, and delivering comprehensive and high-quality app market data to app professionals.Key ResponsibilitiesTake full responsibility for data.ai core intelligence data qualityDeep...

  • Big Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai India subsidiary entity. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing...

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India data Full time

    Overview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...

  • Data Engineer

    1 week ago

    Hyderabad, India NTT DATA Full time

    Job Description Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process...

  • Big Data Engineer, Data Modeling Expert

    2 weeks ago

    Hyderabad, Telangana, India data Full time

    Unlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...

  • Big Data Engineer, Data Modeling Expert

    3 weeks ago

    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...

  • Big Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using...

  • Data Engineer

    2 months ago

    Hyderabad, India NTT DATA Services Full time

    Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process the data...

  • Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Job Title: Data EngineerNTT DATA Services is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and testing scalable Big Data ecosystems for our clients.Key Responsibilities:Analyze and understand data sources and APIsDesign and develop methods to connect and collect data from...

  • Big Data Engineer

    5 days ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Data Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...

  • Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistAt NTT DATA Services, we are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing scalable Big Data ecosystems for our clients. Your expertise will help us build stable and highly optimized data systems, ensuring seamless data processing and...

  • Big Data Systems Engineer

    5 days ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...

  • Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: 291171NTT DATA Services is a global leader in business and technology services, committed to helping clients innovate, optimize and transform for long-term success.We are seeking a skilled Data Engineer to join our team in Hyderabad, Telangana, India, to design, implement and maintain Azure Synapse data pipelines and transformation for data...

  • Data Analyst

    3 weeks ago

    Hyderabad, Telangana, India data Full time

    Job Title: Data AnalystAs a Data Analyst at data.ai, you will play a crucial role in analyzing, monitoring, and delivering comprehensive and high-quality app market data to app professionals. You will be empowered to work independently with the support of team members spread across APAC, AMER, and EMEA.Key Responsibilities:Take full responsibility for...

  • Data Engineer

    4 weeks ago

    Hyderabad, India NTT DATA Services Full time

    Req ID: 291171 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Design, implement and maintain...

  • Data Engineer

    4 weeks ago

    Hyderabad, India NTT DATA Services Full time

    Req ID: 291171  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Design, implement...

  • Data Analyst Position

    2 weeks ago

    Hyderabad, Telangana, India data Full time

    A Career Defining Role in Data IntelligenceAs a Data Analyst, you will play a pivotal role in helping us uncover hidden insights and trends within our vast dataset. Your expertise will be instrumental in ensuring the accuracy and quality of our data, enabling us to make informed decisions that drive business growth.ResponsibilitiesTake ownership of data.ai's...

  • Data Intelligence Specialist

    2 weeks ago

    Hyderabad, Telangana, India data Full time

    Data Quality and InsightsWe are seeking a skilled Data Insights Analyst to join our team at data.ai. As a Data Insights Analyst, you will be responsible for analyzing, monitoring, and delivering comprehensive and high-quality app market data to app professionals.Key Responsibilities:Take full responsibility for data.ai core intelligence data qualityDeep...

  • Data Intelligence Specialist

    3 weeks ago

    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking a highly skilled Data Intelligence Specialist to join our team at data.ai. As a Data Intelligence Specialist, you will be responsible for analyzing, monitoring, and delivering comprehensive and high-quality app market data to app professionals.Key ResponsibilitiesTake full responsibility for data.ai core intelligence data...

  • Data Modeling Expert

    2 weeks ago

    Hyderabad, Telangana, India data Full time

    What drives innovation in data-driven products?We are looking for an experienced data engineer to join our team and contribute to the development of innovative analytics and data products. As a big data engineer, you will be part of a collaborative team that uses agile methodologies and open-source technologies to build cutting-edge data processing programs....