Skip to content

[Hackathon] feat: Dataset Bank + Dataset Search Agent + Results Dashboard #5097

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
EmilySun621 wants to merge 13 commits into
base: main
Choose a base branch
from
Open

[Hackathon] feat: Dataset Bank + Dataset Search Agent + Results Dashboard #5097

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
f64bd66
feat: custom agents, time machine, and per-agent model selection
May 16, 2026
18d5748
feat(agent): add search_datasets tool and inject user datasets into p…
May 16, 2026
eb420b9
feat: results dashboard panel for agent-generated analysis reports
May 16, 2026
76e87ed
wip: project gallery in-progress changes
May 16, 2026
3cb31c0
Revert "wip: project gallery in-progress changes"
May 16, 2026
9ffd4fc
feat(dashboard): add Dataset Bank page at /dashboard/user/dataset-bank
May 16, 2026
3e68fc6
feat(dataset-bank): split actions into Download + Import, wire real u…
May 16, 2026
4d9f198
feat(dataset-bank): server-side import proxy in agent-service
May 16, 2026
8732d2b
fix(agent-service): point dataset proxy at file-service, not amber
May 16, 2026
1bd2477
feat(dataset-bank): add "View on <source>" link to every card
May 16, 2026
af4b9ae
feat(dataset-bank): add PubMed and WHO data sources
May 17, 2026
1bffa17
fix(dataset-bank): rename proxy path /api/dataset-bank → /api/databank
May 17, 2026
23d4bf4
docs(dataset-bank): update JSDoc to reference renamed /api/databank path
May 17, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 1 addition & 19 deletions .run/AccessControlService.run.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,25 +1,7 @@
<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->
<component name="ProjectRunConfigurationManager">
<configuration default="false" name="AccessControlService" type="Application" factoryName="Application">
<option name="MAIN_CLASS_NAME" value="org.apache.texera.service.AccessControlService" />
<module name="texera.access-control-service" />
<module name="texera.access-control-service.main" />
<shortenClasspath name="ARGS_FILE" />
<extension name="coverage">
<pattern>
Expand Down
20 changes: 1 addition & 19 deletions .run/ComputingUnitManagingService.run.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,25 +1,7 @@
<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->
<component name="ProjectRunConfigurationManager">
<configuration default="false" name="ComputingUnitManagingService" type="Application" factoryName="Application">
<option name="MAIN_CLASS_NAME" value="org.apache.texera.service.ComputingUnitManagingService" />
<module name="texera.computing-unit-managing-service" />
<module name="texera.computing-unit-managing-service.main" />
<shortenClasspath name="ARGS_FILE" />
<extension name="coverage">
<pattern>
Expand Down
22 changes: 2 additions & 20 deletions .run/ComputingUnitMaster.run.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,27 +1,9 @@
<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->
<component name="ProjectRunConfigurationManager">
<configuration default="false" name="ComputingUnitMaster" type="Application" factoryName="Application">
<option name="MAIN_CLASS_NAME" value="org.apache.texera.web.ComputingUnitMaster" />
<option name="VM_PARAMETERS" value="@$PROJECT_DIR$/.jvmopts" />
<module name="texera.amber" />
<module name="texera.amber.main" />
<shortenClasspath name="ARGS_FILE" />
<option name="VM_PARAMETERS" value="@$PROJECT_DIR$/.jvmopts" />
<extension name="coverage">
<pattern>
<option name="PATTERN" value="org.apache.texera.web.*" />
Expand Down
22 changes: 2 additions & 20 deletions .run/ComputingUnitWorker.run.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,27 +1,9 @@
<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->
<component name="ProjectRunConfigurationManager">
<configuration default="false" name="ComputingUnitWorker" type="Application" factoryName="Application">
<option name="MAIN_CLASS_NAME" value="org.apache.texera.web.ComputingUnitWorker" />
<option name="VM_PARAMETERS" value="@$PROJECT_DIR$/.jvmopts" />
<module name="texera.amber" />
<module name="texera.amber.main" />
<shortenClasspath name="ARGS_FILE" />
<option name="VM_PARAMETERS" value="@$PROJECT_DIR$/.jvmopts" />
<extension name="coverage">
<pattern>
<option name="PATTERN" value="org.apache.texera.web.*" />
Expand Down
20 changes: 1 addition & 19 deletions .run/ConfigService.run.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,25 +1,7 @@
<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->
<component name="ProjectRunConfigurationManager">
<configuration default="false" name="ConfigService" type="Application" factoryName="Application">
<option name="MAIN_CLASS_NAME" value="org.apache.texera.service.ConfigService" />
<module name="texera.config-service" />
<module name="texera.config-service.main" />
<shortenClasspath name="ARGS_FILE" />
<extension name="coverage">
<pattern>
Expand Down
20 changes: 1 addition & 19 deletions .run/FileService.run.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,25 +1,7 @@
<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->
<component name="ProjectRunConfigurationManager">
<configuration default="false" name="FileService" type="Application" factoryName="Application">
<option name="MAIN_CLASS_NAME" value="org.apache.texera.service.FileService" />
<module name="texera.file-service" />
<module name="texera.file-service.main" />
<shortenClasspath name="ARGS_FILE" />
<extension name="coverage">
<pattern>
Expand Down
20 changes: 1 addition & 19 deletions .run/TexeraWebApplication.run.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,25 +1,7 @@
<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->
<component name="ProjectRunConfigurationManager">
<configuration default="false" name="TexeraWebApplication" type="Application" factoryName="Application">
<option name="MAIN_CLASS_NAME" value="org.apache.texera.web.TexeraWebApplication" />
<module name="texera.amber" />
<module name="texera.amber.main" />
<shortenClasspath name="ARGS_FILE" />
<extension name="coverage">
<pattern>
Expand Down
20 changes: 1 addition & 19 deletions .run/WorkflowCompilingService.run.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,25 +1,7 @@
<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->
<component name="ProjectRunConfigurationManager">
<configuration default="false" name="WorkflowCompilingService" type="Application" factoryName="Application">
<option name="MAIN_CLASS_NAME" value="org.apache.texera.service.WorkflowCompilingService" />
<module name="texera.workflow-compiling-service" />
<module name="texera.workflow-compiling-service.main" />
<shortenClasspath name="ARGS_FILE" />
<extension name="coverage">
<pattern>
Expand Down
8 changes: 7 additions & 1 deletion agent-service/.env.example
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,5 +17,11 @@ LLM_ENDPOINT=http://localhost:9096

# Texera backend services
TEXERA_DASHBOARD_SERVICE_ENDPOINT=http://localhost:8080
TEXERA_FILE_SERVICE_ENDPOINT=http://localhost:9092
WORKFLOW_COMPILING_SERVICE_ENDPOINT=http://localhost:9090
WORKFLOW_EXECUTION_SERVICE_ENDPOINT=http://localhost:8085
WORKFLOW_EXECUTION_SERVICE_ENDPOINT=http://localhost:8085

# Optional Kaggle API credentials for the search_datasets agent tool. Without
# these, the tool skips Kaggle and queries dkNET / UCI only.
# KAGGLE_USERNAME=
# KAGGLE_KEY=
Loading
Loading