Skip to content
View HopeFan's full-sized avatar
🎯
Focusing
🎯
Focusing
4 followers · 16 following

Achievements

Achievement: Pair ExtraordinaireAchievement: QuickdrawAchievement: YOLOAchievement: Pull Sharkx2

Achievements

Achievement: Pair ExtraordinaireAchievement: QuickdrawAchievement: YOLOAchievement: Pull Sharkx2

Block or report HopeFan

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
HopeFan/README.md

Hi there, I'm Erfan 👋

🔧 Senior Data Engineer building enterprise data and AI platforms

📝 I write Pipeline to Insights, a data and AI publication reaching 10,000+ subscribers across 150+ countries, recognised as a Substack Bestseller.

LinkedIn Substack

⭐ Highlights

🎤 Speaking and Community

  • Co-organiser, DataEngBytes, Oceania's largest independent data engineering conference (500+ attendees)
  • Community Manager, AI Camp Melbourne (~12 events, 600–700+ professionals)
  • Speaker:"Building an AI-Powered Data Catalogue" (DataEngBytes 2026), "OpenMetadata MCP Server & AI SDK" (2026), "Tackling Data Quality in the Age of AI" (AI Camp Australia, 2024)
  • Finalist, Ally of the Year, Australian Professionals of Multicultural Communities (APOC) Awards, 2026, recognising leadership in advocacy and inclusion.

📰 Recent Articles

Date Article
2026-07-19 Agents in Action #5: Sub-Agents, Delegating Work to Focused Workers
2026-07-12 Agents in Action #4: Skills, Teaching Your Agent Your Workflows
2026-07-08 The Human Skills Every Technical Professional Needs
2026-06-28 Agents in Action #3: Model Context Protocol (MCP) for Data Engineers
2026-06-21 Agents in Action #2: How Agents Interact with the Real World

See all articles →

🚀 Projects

  • substack-agent — CLI agent that automates drafting and publishing for Pipeline to Insights, built with Claude Code, workflow orchestration, and prompt caching.
  • AI-Powered Analytics with OpenMetadata MCP — metadata-driven platform integrating PostgreSQL, dbt, Metabase, OpenMetadata, and MCP for conversational, self-service analytics and automated governance.

🛠️ Tech Stack

⚡ Currently building AI-ready data platforms and writing about agentic data engineering.

Pinned Loading

  1. pipelinetoinsights/bluesky-to-s3-dlt-pipeline pipelinetoinsights/bluesky-to-s3-dlt-pipeline Public

    This repository contains an end-to-end data ingestion pipeline from Bluesky API to S3 using Dagster.

    Python 3 1

  2. pipelinetoinsights/elt-pipeline-with-dlt-and-dbt pipelinetoinsights/elt-pipeline-with-dlt-and-dbt Public

    This repository contains an end-to-end ELT pipeline prepared for Data Engineering Interview Series of Pipeline To Insights.

    Python 5

  3. pipelinetoinsights/data-quality-framework-with-dbt pipelinetoinsights/data-quality-framework-with-dbt Public

    This is an example of implementing data quality checks with dbt prepared by Pipeline To Insights for tutorial purposes.

    Dockerfile 2 1

  4. aboyalejandro/agentic-data-modeling aboyalejandro/agentic-data-modeling Public

    Showcasing AI Data Modeling with Lineage & impact analysis on OpenMetadata

    Python 20 4

  5. pipelinetoinsights/agent-in-action-series pipelinetoinsights/agent-in-action-series Public

    Python