About

Designation / Job title : Developer programmer - 261312

Primary or Mandatory skills :-
Advanced proficiency in Google Cloud Platform (GCP): BigQuery, Dataflow, Cloud Functions, Cloud Storage, Composer, Cloud Run, Pub/Sub, Firestore, Cloud Build
Experience in AI/ML integration using Vertex AI, BigQuery ML, Agent Builder, and Streamline
Expertise in Site Reliability Engineering (SRE) practices: SLIs/SLOs/SLAs, error budgets, incident response, postmortems
• Hands-on experience with IBM Databand for data observability: real-time alerts, predictive monitoring, data lineage tracking
• Proficient in Python, Pyspark, Unix/Shell scripting, and Google Apps Script for automation and alerting
• Advanced SQL skills with BigQuery, Vertica, and Oracle
• Strong understanding of Apache Airflow for DAG orchestration and pipeline scheduling

Good to have skills :
Familiarity with Agile methodologies, Jira, and ServiceNow
Experience with Looker Pro and Tableau for advanced BI and reporting
Exposure to cloud migration strategies and cross-platform data integration

Experience with Atlan for data governance: metadata cataloging, lineage tracking, access control, and collaboration across data teams
Knowledge of Profisee for reference data management: mastering business-critical entities, hierarchy management, and golden record creation

Detailed Job description : -
• • Lead the development, deployment, and support of scalable data pipelines on Google Cloud Platform, using services such as Dataflow, BigQuery, Cloud Functions, Firestore, Composer, Cloud Storage, Cloud Run, and Pub/Sub.
• Architect and optimize complex SQL queries in BigQuery and Vertica to improve performance and reduce query costs.
• Design and orchestrate workflows using Apache Airflow, including DAG creation, scheduling, and monitoring.
• Implement platform-wide cost and resource optimization strategies:
• Archive historical and cold data to lower-cost storage tiers
• Delete unused datasets and files from Cloud Storage
• Monitor service usage across projects and decommission idle or redundant resources
• Set up new GCP projects with cost-efficient architecture
• Maintain GitHub repositories for CI/CD pipelines and deployment automation
• Automate operational workflows and alerting systems using Python, Unix/Shell scripting, and Google Apps Script, enabling real-time notifications for pipeline failures and anomalies.
• Integrate AI/ML capabilities into operations using Vertex AI, Agent Builder, BigQuery ML, and Streamlit to detect anomalies, predict failures, and reduce recurring incidents.
• Apply SRE principles to improve system reliability, scalability, and operational efficiency:
• Define and monitor SLIs/SLOs/SLAs for critical services
• Conduct post-incident reviews and prepare RCA documentation
• Manage error budgets and balance feature velocity with system stability
• Automate incident detection and resolution workflows to reduce MTTR
• Deploy and manage IBM Databand for advanced data observability:
• Configure real-time alerts for pipeline delays, schema changes, and data freshness
• Enable predictive monitoring and data lineage tracking
• Improve operational resilience and data reliability across critical workloads
• Perform Google Cloud administration tasks:
• Manage IAM roles and access policies
• Perform Composer upgrades and environment tuning
• Configure VPC networks, firewall rules, and service accounts
• Provision and monitor Compute Engine instances and Kubernetes clusters (GKE)
• Use Terraform for infrastructure-as-code deployments
• Collaborate with business and technical teams for Finance month-end and year-end closures, including data loads and issue resolution.
• Provide SME-level support for Finance, Subscription, AdSales, and Consumer data domains.
• Manage sprint planning and change control processes using Jira and ServiceNow.
• Investigate and resolve data issues raised by business users in BigQuery, Looker reports, and other platforms; prepare RCA documentation.
• Conduct stakeholder meetings for requirement gathering, technical mapping, and production deployment planning.
• Mentor junior engineers and support team development through training and documentation.
Skill – As mentioned above
Experience Range – 7+ years