15h Left) Senior Gcp Data Engineer

Come Join UsExperience com - We make every experience matter morePosition Senior GCP Data EngineerJob Location Chennai Base Location RemoteEmployment Type Full TimeSummary of PositionA Senior Data Engineer is a professional who specializes in preparing big data infrastructure for analytical or operational uses He She is responsible for develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity They collaborate with data scientists and business teams to improve data models that feed business intelligence tools increasing data accessibility and fostering data-driven decision making across the organisation Responsibilities Collaborate with cross-functional teams to define prioritize and execute data engineering initiatives aligned with business objectives Design and implement scalable reliable and secure data solutions by industry best practices and compliance requirements Drive the adoption of cloud-native technologies and architectural patterns to optimize the performance cost and reliability of data pipelines and analytics solutions Mentor and lead a team of Data Engineers Demonstrate a drive to learn and master new technologies and techniques Apply strong problem-solving skills with an emphasis on building data-driven or AI-enhanced products Coordinate with ML AI and engineering teams to understand data requirements Experience Skills 8 years of Strong experience in ETL and ELT data from various sources in Data Warehouses 8 years of experience in Python Pandas Numpy and SciPy 5 years of Experience in GCP 5 years of Experience in BigQuery PySpark and Pub Sub 5 years of Experience working with and creating data architectures Certified in Google Cloud Professional Data Engineer Advanced proficiency in Google Cloud services such as Dataflow Dataproc Dataprep Data Studio and Cloud Composer Proficient in writing complex Spark PySpark User Defined Functions UDFs Spark SQL and HiveQL Good understanding of Elastic search Experience in assessing and ensuring data quality data testing and addressing data quality issues Excellent understanding of Spark architecture and underlying frameworks including storage management Solid background in database design and development database administration and software engineering across full life cycles Experience with NoSQL data stores like MongoDB DocumentDB and DynamoDB Knowledge of data governance principles and practices including data lineage metadata management and access control mechanisms Experience in implementing and optimizing data security controls encryption and compliance measures in GCP environments Ability to troubleshoot complex issues perform root cause analysis and implement effective solutions in a timely manner Proficiency in data visualization tools such as Tableau Looker or Data Studio to create insightful dashboards and reports for business users Strong communication and interpersonal skills to effectively collaborate with technical and non-technical stakeholders articulate complex concepts and drive consensus Experience with agile methodologies and project management tools like Jira or Asana for sprint planning backlog grooming and task tracking About UsWe believe that experience is everything Experience com has built the most impactful Experience Management Platform XMP available anywhere with features to drive operational and behavioral change in real-time during the moments that matter XMP delivers impactful business outcomes including increased customer satisfaction brand loyalty online reputation and visibility as well as improved employee engagement and compliance - making every experience matter more Founded in 2015 and originally founded as SocialSurvey Experience com is headquartered in San Ramon Calif and backed by SavantGrowth fka Kennet Partners Silicon Valley Data Capital Tri-Valley Ventures and Wilson Sonsini Goodrich Rosati Indian Registered name Buyers Road India Private LimitedURL