Data engineer

Role : Data EngineerLocation : RemoteShift Timing : 2:00 Pm - 11:00 PmExperience : 2- 4 years relevant only ( this is a Junior position with us )Must have skillset :GCP - 2 years minimumPython and Pyspark - 2 yearsSQL - 2 yearsExcellent communicationWorked with global stakeholdersWho we are:Randstad Sourceright’s global talent solutions provides instant access to experienced recruitmentand contingent workforce management support by combining technology, analytics and deepglobal and local expertise. Our operations consist of the client aligned service delivery teamsoperating across RPO, MSP and Blended Workforce Solutions. We are certified as a “great place towork” for the last 3 consecutive years and are recognized as the best place to work by GlassdoorGroup ObjectiveThe mission of the business intelligence team is to create a data-driven culture that empowers leaders to integrate data into daily decisions and strategic planning. We aim to provide visibility, transparency, and guidance regarding the quantity and quality of results, activities, financial KPIs, and leading indicators to identify trends aimed at data-based decision-making easily.Position ObjectiveAs a Senior Data Engineer, you will be responsible for designing, architecting, and implementing robust data solutions in a cloud-based environment (GCP). You will partner with other data engineers and technical teams to ensure the availability, reliability, and performance of our data systems.Position SummaryProgramming & Code WritingArchitect and build complex data pipelines using advanced cloud data technologiesLead efforts to optimize data pipelines for performance, scalability, and cost-efficiencyDefine industry best practices for building data pipelinesEnsure data security, compliance, and governance standards are met.Partner with leadership team to define and implement agile and Dev Ops methodologiesConsulting & PartnershipServe as subject matter expert and define data architecture and infrastructure requirementsPartner with business analysts to plan project execution including appropriate product and technical specifications, direction, resources, and establishing realistic completion timesUnderstand data technology trends and identify opportunities to implement new technologies and provide forward-thinking recommendationsProactively partner with internal stakeholders to bridge gaps, provide historical references, and design the appropriate processesTroubleshooting & Continuous ImprovementDesign and implement a robust data observability processResolve escalated reporting requests and communicate proactively and timelyTroubleshoot, and provide technical guidance to resolve issues related to misaligned or inaccurate data or data fields or new customer requirementsMaintain new release, migration, and sprint schedules for software upgrades, enhancements, and fixes to aid with product evolutionWrite QA/QC Scripts to conduct first round of testing and partner with BA team for test validation for new developments prior to moving to productionUse industry knowledge & feedback to aid in the development of technology roadmap and future product(s) visionDocument standard ways of working via QRGs, intranet pages, and video seriesSenior activitiesDrive day-to-day development activities of development team in close collaboration with on-site and off-shore resources, scrum masters and product ownersBootstrapping a data engineering team at an early stage in the team’s evolutionProvide leadership on technical front in difficult situations facilitate contentious discussions, and report up when necessaryGuide, mentor and coach offshore resourcesProvide input in forming a long-term data strategyEducation Master’s degree in Computer Science / Information Technology or related field, highly preferredExperienceExtensive knowledge of BI concepts and related technologies that help drive sustainable technical solutionsExtensive Experience with data lakes, ETL and data warehousesAdvanced experience of building data pipelinesPassion for building quality BI softwareProject Management and/or process improvement experience highly preferred Knowledge, Skills, and AbilitiesPolyglot coder and expert level in multiple languages including, Python, R, Java, SQL, relational databases, ERP, DOMO or other data visualization tools i.e. TableauAdvanced and proven experience with Google cloud platform (GCP) is preferred. But experience with Microsoft Azure / Amazon will be considered.Any exposure to Kafka, Spark, and Scala will be an added advantage.Should demonstrate a strong understanding of OOPS concepts and methodologiesExpert level understanding of data engineeringIntrinsic motivation and problem-solvingProactive leadership, project management, time management, and problem-solving skillsDemonstrated continuous improvement, process documentation, and workflow skillsExtensive experience with data analysis , modeling, and data pipelining including data cleaning, standardizing, scaling, tuning, scheduling and deploymentExperience composing detailed technical documentation and procedures for data modelsAbility to prioritize and manage multiple projects, tasks, and meeting deadlines while maintaining qualityStrong drive and commitment for delivering outstanding resultsStrong follow up and service orientationSupervisory Responsibility ☒ Provides guidance, leadership, or training to junior employees☐ Directly responsible for supervising non-exempt, clerical, or office administrative personnel☐ Directly responsible for supervising exempt, professional, or technical employees☒ Directly responsible for supervising supervisory/managerial employeesOrganizational Structure:Job Title this position reports: Manager, Data Engineering