Data Engineering & Cloud Modernization Tools in AI answers

Data as of Oct 22, 2026Based on 49 AI responsesReviewed by Dimitry Apollonsky

AI summary

Apache Airflow holds a narrow lead over Dagster for data engineering workflows. For teams needing to unpack black-box data transformations using SQL, dbt is the usual answer.

Most-mentioned brands

Rank and Mentioned in · since Sep 24

#	Brand	Recommended for	Mentioned in
1	OpenMetadata 47% comprehensive data discovery, quality, and end-to-end lineage tracking	comprehensive data discovery, quality, and end-to-end lineage tracking	47%
2	Apache AirflowApache Software Foundation product line 33% orchestrating and scheduling automated data extraction and transformation pipelines	orchestrating and scheduling automated data extraction and transformation pipelines	33%
2	Apache AtlasApache Software Foundation product line 27% open-source data cataloging and metadata management across systems	open-source data cataloging and metadata management across systems	27%
2	dbt 27% teams running SQL transformations with clear lineage and documentation	teams running SQL transformations with clear lineage and documentation	27%
2	Atlan 24%		24%
2	Dagster 24% modern data orchestration and automated pipeline execution workflows	modern data orchestration and automated pipeline execution workflows	24%
2	Collibra 22%		22%
2	DataHub · datahub.com 20% active data cataloging and integrating dbt metadata for lineage	active data cataloging and integrating dbt metadata for lineage	20%
2	Amundsen 20% open-source data cataloging and searchable documentation for teams	open-source data cataloging and searchable documentation for teams	20%
2	Azure Data FactoryMicrosoft product line 20% cloud-based data integration and automated data pipeline generation	cloud-based data integration and automated data pipeline generation	20%
2	AWS GlueAmazon product line 20% automated data extraction, transformation, and loading in the cloud	automated data extraction, transformation, and loading in the cloud	20%
2	Matillion 20%		20%
2	Fivetran 20%		20%
2	Marquez 20%		20%
15	Alation 16%		16%
15	Prefect CloudPrefect product line 16%		16%
15	DataHub · datahub.io 14% active data cataloging and integrating dbt metadata for lineage	active data cataloging and integrating dbt metadata for lineage	14%
15	OpenLineage 14%		14%
15	Informatica 14%		14%
15	Databricks 14% large-scale data engineering workflows and unified data processing	large-scale data engineering workflows and unified data processing	14%
15	Microsoft PurviewMicrosoft product line 12%		12%
15	Microsoft Purview Records ManagementMicrosoft product line 12%		12%
15	Airbyte 12%		12%
15	AWSAmazon product line 12%		12%
15	Snowflake AISnowflake product line 10%		10%
15	Microsoft AzureMicrosoft product line 10%		10%
15	Microsoft 10%		10%
15	AWS Lake FormationAmazon product line 8%		8%
15	Prefect 8%		8%
15	Kestra 8%		8%
15	Databricks Unity CatalogDatabricks product line 8%		8%
15	CKAN 8%		8%
15	Mage 8%		8%
34	Microsoft FabricMicrosoft product line 6%		6%
34	Immuta 6%		6%
34	Databricks LakeflowDatabricks product line 6%		6%
34	Snowflake 6%		6%
34	dbt Clouddbt product line 6%		6%
34	Astronomer 4%		4%
34	ActiveBatchAdvSysCon product line 4%		4%
34	Apache RangerApache Software Foundation product line 4%		4%
34	Privacera 4%		4%
34	ISO/IEC 27001International Organization for Standardization (ISO) product line 4%		4%
34	Google Cloud DataflowAlphabet product line 4%		4%
34	Apache HadoopApache Software Foundation product line 4%		4%
34	Open Policy Agent 4%		4%
34	dbt Coredbt product line 4%		4%
34	Okta 4%		4%
34	AWS Glue Data Catalog 4%		4%
34	Amazon RedshiftAmazon product line 4%		4%
34	EDM Council 2%		2%
34	IBM 2%		2%
34	Collibra Data GovernanceCollibra product line 2%		2%
34	Integrate.io 2%		2%
34	Google Cloud ComposerAlphabet product line 2%		2%
34	Collibra Data CatalogCollibra product line 2%		2%
34	OneTrust 2%		2%
34	NIST SP 800-53U.S. Department of Commerce product line 2%		2%
34	Microsoft LearnMicrosoft product line 2%		2%
34	Argo Workflows 2%		2%
34	Talend 2%		2%
34	Apache HopApache Software Foundation product line 2%		2%
34	Keboola 2%		2%
34	Informatica Intelligent Data Management CloudInformatica product line 2%		2%
34	AWS Glue Workflows 2%		2%
34	Permit 2%		2%
34	Cerbos 2%		2%
34	Imply 2%		2%
34	NIST Cybersecurity FrameworkU.S. Department of Commerce product line 2%		2%
34	AWS QAmazon product line 2%		2%
34	Salesforce CRMSalesforce product line 2%		2%
34	NIST Privacy FrameworkU.S. Department of Commerce product line 2%		2%
34	Google Cloud DataplexAlphabet product line 2%		2%
34	Qlik Talend CloudQlik product line 2%		2%
34	NIST SP 800-207U.S. Department of Commerce product line 2%		2%
34	AWS Step FunctionsAmazon product line 2%		2%
34	Glean 2%		2%
34	IBM DataStageIBM product line 2%		2%
34	Elastic Enterprise SearchElastic product line 2%		2%
34	Google Cloud BigQueryAlphabet product line 2%		2%
34	Apache SparkApache Software Foundation product line 2%		2%
34	SlackSalesforce product line 2%		2%
34	Microsoft EntraMicrosoft product line 2%		2%
34	Amazon S3Amazon product line 2%		2%
34	Okta Identity GovernanceOkta product line 2%		2%
34	Palo Alto Networks 2%		2%
34	Azure Synapse AnalyticsMicrosoft product line 2%		2%
34	Apache FlinkApache Software Foundation product line 2%		2%

Who leads each AI engine

ChatGPT SearchChatGPT Search: =1OpenMetadata Marquez+3
Google AI ModeGoogle AI Mode: =1OpenMetadata Apache Airflow+3

Mentioned in on each engineChatGPT SearchGoogle AI Mode

Widest split: DataHub, 32% on ChatGPT Search and 8% on Google AI Mode.

Mentioned in on each AI engine, by brand
Brand	ChatGPT Search	Google AI Mode
OpenMetadata	52%	42%
Marquez	36%	Outside Google AI Mode's top 25
Apache Airflow	32%	33%
Amundsen	16%	25%
DataHub	32%	8%
Apache Atlas	28%	25%
dbt	32%	21%
Azure Data Factory	16%	25%
Atlan	28%	21%
Dagster	28%	21%

Latest insights

Weeks of Sep 21 – Oct 15, 2026 · Since Jul 5

OpenMetadata Gaining: OpenMetadata ranked #17 in Data Engineering & Cloud Modernization Tools last week and #10 this week
OpenMetadata Gaining: OpenMetadata broke into the top ten in Data Engineering & Cloud Modernization Tools, ranking #10
Collibra Gaining: Collibra ranked #28 in Data Engineering & Cloud Modernization Tools last week and #6 this week
Collibra Gaining: CollibraSecoda now trails Collibra in Data Engineering & Cloud Modernization Tools
Collibra Gaining: Collibra's mention rate increased to 22.4% in Data Engineering & Cloud Modernization Tools, from 15.5% the week before

and 7 more insightssee the ranking

Questions and answers

The problem is, our data transformations are a black box. What's the best data transformation tool that is based on SQL?

Sources AI cites100

62% of citations point at the ranked brands’ own sites. github.com, datacatalog.net, domo.com are the most-cited sites outside the ranked brands’ own domains.

Data Engineering & Cloud Modernization Tools in AI answers

Is your brand in this ranking?

Most-mentioned brands

Latest insights

Questions and answers

Sources AI cites100

See where your brand stands in this ranking

ELT and Data Transformation Tools

See where your brand stands in this ranking

Most-mentioned brands

Latest insights

Questions and answers

Sources AI cites100

See where your brand stands in this ranking

Related markets

ELT and Data Transformation Tools

See where your brand stands in this ranking