| about: | TLDR: - Senior Data Engineer (Ex-Google)
- 15+ years experience
- Python, Java, Go, C, SQL
- Free consultation: https://calendly.com/ajwelch/15-minute-consultation
- Engagement model: 2-week sprints @ $15k per-sprint upfront Services: - Development
- ELT: Any data warehouse, dbt, SQLMesh, Dataform
- ETL: Any Python, Java or Go ETL framework
- Streaming: Kafka, Flink, Dataflow/Beam, Spark
- CDC/Replication: Debezium, dlt, Airbyte
- Orchestration: Airflow, Prefect, Dagster
- Optimization
- Performance and cost optimization
- Resource utilization and capacity planning
- Query execution log and explain plan analysis
- Query rewriting and refactoring
- Data model and storage optimization
- Modernization
- Rewrite, transpile and translate legacy systems:
- Oracle, Teradata, Hive, Informatica, DataStage, etc.
- Leverage automated parsing and compilation tools:
- sqlglot, jOOQ, Apache Calcite, OpenRewrite, BQMS
- Observability
- Data quality framework implementation:
- Great Expectations, Soda, Data Validation Tool
- Data lineage, root cause and impact analysis
- Logging, monitoring and alerting implementation
- Automation
- Static analysis and build tool automation
- CI/CD: Argo, Dagger, Jenkins
- IaC: Teraform/CDKTF, Helm/CDK8s, Talos, KVM
- Strategy
- Architecture, system design and tech stack selection
- Data mesh, governance, discovery and sharing
- Backlog prioritization, roadmap and sprint planning Contact: Free consultation: https://calendly.com/ajwelch/15-minute-consultation
Email: aj@ajwelch.dev
Website: ajwelch.dev
LinkedIn: https://www.linkedin.com/in/ajwelch4/ |