Data Engineer II

2 months ago

chennai, India PDI Technologies Full time

Overview


PDI, the leader in enterprise management software for the convenience retail and petroleum wholesale markets, delivers solutions to connect to intelligent business. Our people-first approach, combined with our 35-year heritage and best-in-class technology, helps our customers thrive in today’s digital economy. We’re passionate about our customers’ & employees’ success and delivering exceptional experiences. Our vision is simple: we want to be the global leader in enterprise management software to the convenience retail and petroleum wholesale industries, and we’re well on our way. People often say it takes a village to raise a child. The same could be said of building a great company. With the help of our amazing team and loyal customers, we’re writing new pages in our success story every day. Join us for the next chapter

Job Summary

If you love to develop great quality software and are eager to learn new technologies and develop new skills, then we have a great opportunity for you: join our PDI family and work closely with other talented PDI engineers to deliver solutions that delight our customers every day 

As a Data Engineer II, you will be part of an agile data services team responsible for developing and maintaining our industry-leading cloud-based big data and data analytics infrastructure serving major global fortune companies. The candidate will help with design, development, unit testing, performance testing, deployment, troubleshooting, defect resolution, and support of our data services infrastructure.

Responsibilities

Utilize architectural and design skills for a variety of data-oriented tasks Establish and maintain strong relationships with business stakeholders Build high reliability systems that provide complete, secure, accurate and timely data for analytics, data modeling, new product features and services - including financial reporting Assist development and analytics organization to meet its delivery goals with regard to data deign, flow and infrastructure Perform Data Modeling, Architecture design and implementation to support OLTP and Warehousing applications assist features in Data flow design and Data Mentor other team members Work with business users to understand business requirements, issues and business and/or client processes Hands on coding of data pipelines Hands on administration of existing databases and big data systems Develop, test, and maintain high-performance of our data systems to meet the requirements of the business and/clients while adhering to departmental standards Perform quality assurance testing for all work performed Prepare required documentation as outlined by departmental standards Meet with agile teams as required to define and document application requirements Follow project development & deployment process Maintain industry standards and best practices Maintain security and organization of the company’s data Provide off-hour support as assigned Provide high level estimates for new business requirements/features Work with manager to ascertain the company’s data requirements Install new databases, data pipelines, maintain existing databases and data pipelines Design and implement processes and solutions for data distribution and data archiving Develop and implement backup and recovery plans to mitigate the possibility of data loss Monitor storage space, storage capacity, and system performance Identify, analyze and repair data problems as needed Provide recommendations for application and system improvements Plan work to meet project deadlines, accommodate demands by development teams, set priorities and escalate issues appropriately Provide recommendations to development teams for data restructuring and performing complex maintenance Deploy and manage changes in development, staging and production Assist development and dev ops teams on SQL queries and tuning

Knowledge, Skills & Abilities

Strong management skills with at least 4 years of experience building, managing and maintaining a team of Data Engineers/ DBAs At least 4 years of experience in basic-level administration of both data infrastructure and data At least 3 years coding experience in Java, Python, R or other equivalent programming language At least 4 years big data and data architecture experience Proficient in a variety of big-data tools and technologies, including Hadoop, Spark, etc. Proficient in SQL and PL-SQL, query tuning, optimization, ETL, ELT, and Data Warehousing Experience in custom archive and purge procedures and scripts Proficient in Business Intelligence (BI), analytic database and products, able to take business requirements and translate into database and pipeline design and tasks General data-specific concepts, frameworks and processes Agile development practices Working within an SDLC Designing data warehouses including definition, structure, documentation, maintenance, long-range requirements, operational guidelines, and protection Linux operating systems Data integration and processing including extraction, transformation, and loading (ETL), data analysis, and metadata

Other Skills and Experience

Cloud experience, such as AWS, GCP or Azure Excellent oral and written communication Multi-tasking and managing multiple priorities Working well in a team-oriented, collaborative environment with people from different disciplines and varying degrees of technical experience Working in an Agile team environment

PDI’s employee oriented culture provides a supportive and dynamic work environment for high achievers. PDI seeks individuals who value continuous learning, hold high ethical standards, and are top performers in their respective field. We offer competitive wages, professional development, superb culture, and an extensive life enriching benefits package. To review the opportunities available at PDI please visit our career site at . PDI is an Equal Opportunity Employer. We verify employment eligibility for all new-hires using e-Verify.

  • Data Scientist Ii

    1 month ago

    Chennai, India Caterpillar Full time

    **Career Area**:Information Analytics**: JOB PURPOSE: Caterpillar uses quantitative methods such as business simulations, data mining, and advanced statistical techniques to solve problems. The Data Scientist II contributes to this mission by leveraging his or her quantitative analysis, data management, modeling and/or data visualization skills as an...

  • Data Engineer II

    2 months ago

    Chennai, India PDI Technologies Full time

    Overview PDI, the leader in enterprise management software for the convenience retail and petroleum wholesale markets, delivers solutions to connect to intelligent business. Our people-first approach, combined with our 35-year heritage and best-in-class technology, helps our customers thrive in today’s digital economy. We’re passionate about our...

  • Data Engineer II

    2 months ago

    Chennai, India PDI Technologies Full time

    OverviewPDI, the leader in enterprise management software for the convenience retail and petroleum wholesale markets, delivers solutions to connect to intelligent business. Our people-first approach, combined with our 35-year heritage and best-in-class technology, helps our customers thrive in today’s digital economy. We’re passionate about our...

  • Data Scientist II

    1 week ago

    chennai, India RELX India (Pvt) Ltd Risk div Company Full time

    About the role Data Scientist II in our vibrant and forward-thinking Innovation Engineering Group, you will be at the forefront of using advanced data analysis and modelling techniques to drive innovative solutions. Responsibilities: Participating in end-to-end modelling projects, handling large variety and volume of data. Conducting exploratory...

  • Data Engineer II

    2 months ago

    Chennai, India PDI Technologies Full time

    Overview PDI, the leader in enterprise management software for the convenience retail and petroleum wholesale markets, delivers solutions to connect to intelligent business. Our people-first approach, combined with our 35-year heritage and best-in-class technology, helps our customers thrive in today’s digital economy. We’re passionate about our...

  • Data Engineer II

    1 week ago

    Chennai, India PDI Technologies Full time

    Overview PDI, the leader in enterprise management software for the convenience retail and petroleum wholesale markets, delivers solutions to connect to intelligent business. Our people-first approach, combined with our 35-year heritage and best-in-class technology, helps our customers thrive in today’s digital economy. We’re passionate about our...

  • Iis(Infrastructure Monitoring)

    10 hours ago

    Chennai, Tamil Nadu, India Encora Full time

    **IIS (Infrastructure Monitoring)** **Important Information** **Location**:Chennai **Experience**: 6+ years **Job Mode**: Full-time **Work Mode**: Hybrid **Job Summary** **Responsibilities and Duties** - Logging and Monitoring IIS logs Event Viewer Performance / Health check Knowledge on any Monitoing tools IIS Enable/ Disable App logs Protocols that...

  • Data Engineer

    3 weeks ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 280008 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Data Engineer...

  • Data Engineer

    3 weeks ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 280008 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Data Engineer...

  • CloudOps Engineer II

    2 months ago

    chennai, India PDI Technologies Full time

    About PDI With 40 years of industry leadership, PDI Technologies resides at the intersection of productivity and sales growth, delivering powerful solutions that serve as the backbone of the convenience retail and petroleum wholesale ecosystem. By “Connecting Convenience” across the globe, we empower businesses to increase productivity, make informed...

  • CloudOps Engineer II

    1 week ago

    chennai, India PDI Technologies Full time

    About PDI With 40 years of industry leadership, PDI Technologies resides at the intersection of productivity and sales growth, delivering powerful solutions that serve as the backbone of the convenience retail and petroleum wholesale ecosystem. By “Connecting Convenience” across the globe, we empower businesses to increase productivity, make informed...

  • CloudOps Engineer II

    2 months ago

    Chennai, India PDI Technologies Full time

    About PDI With 40 years of industry leadership, PDI Technologies resides at the intersection of productivity and sales growth, delivering powerful solutions that serve as the backbone of the convenience retail and petroleum wholesale ecosystem. By “Connecting Convenience” across the globe, we empower businesses to increase productivity, make informed...

  • CloudOps Engineer II

    1 week ago

    Chennai, India PDI Technologies Full time

    About PDI With 40 years of industry leadership, PDI Technologies resides at the intersection of productivity and sales growth, delivering powerful solutions that serve as the backbone of the convenience retail and petroleum wholesale ecosystem. By “Connecting Convenience” across the globe, we empower businesses to increase productivity, make informed...

  • Data Engineer

    3 weeks ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 269806 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN).Azure Data...

  • Data Engineer

    3 weeks ago

    chennai, India NTT DATA Full time

    Job Description Req ID:  269806  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN). Azure Data...

  • Data Engineer

    2 weeks ago

    chennai, India NTT DATA Full time

    Job Description Req ID:  269806  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN). Azure Data...

  • Data Engineer

    2 weeks ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 269806 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN).Azure Data...

  • Data Engineer

    1 week ago

    chennai, India NTT DATA Full time

    Job Description Req ID:  269806  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN). Azure Data...

  • Data Engineer

    1 week ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 269806 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN).Azure Data...

  • Data Engineer

    3 weeks ago

    Chennai, India NTT DATA Services Full time

    Req ID: 280008 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Data Engineer...