DEV Community

Cover image for Using the Screen Tool kit with goose
Ibrahim |
Ibrahim |

Posted on

Using the Screen Tool kit with goose

Content

In this post, we’ll explore how to use the Goose screen toolkit alongside Goose AI to enhance productivity and streamline your workflows.

Table of Contents

  1. What is Goose?
  2. Getting Started with Goose AI
  3. Using Goose for Screenshots

What is Goose?

Goose is your AI-powered agent designed to:

  • Automate repetitive tasks.
  • Assist in debugging.
  • Help you write code more efficiently.

It’s a tool aimed at boosting productivity for developers and tech enthusiasts alike.


Getting Started with Goose AI

Step 1: Install Goose

The first step is to download and install Goose. Visit the official Goose installation page for instructions tailored to your operating system.


Step 2: Obtain API Keys

To connect Goose with your AI provider, you need to obtain API keys. For OpenAI, visit the API Key page and follow the instructions to generate your key.


Step 3: Configure Goose Profiles

After installing Goose, edit the profiles.yaml file to add the screen toolkit. Use your preferred text editor to update the configuration as follows:

~/.config/goose/profiles.yaml
default:
  provider: openai
  processor: gpt-4o
  accelerator: gpt-4o
  moderator: passive
  toolkits:
    - name: developer
      requires: {}
    - name: screen
      requires: {}
Enter fullscreen mode Exit fullscreen mode

Save changes and exit

Start goose session by typing

   goose session start
Enter fullscreen mode Exit fullscreen mode

Taking Screenshots in the Goose Terminal

To capture a screenshot using Goose, simply type:

Take the screenshot of my system
Enter fullscreen mode Exit fullscreen mode

Image description

Enter the command to open the image

open /tmp/goose_screenshot_87f9f7e4e51c4895bb265fc26091d66e.jpg

Creating HTML Page from a Screenshot

  • Let’s take it a step further by creating a simple HTML page based on a screenshot. Here’s the screenshoot that we're going to ask to goose to take: Image description

Capturing the Screenshot

  • Ensure the desired file is open in your IDE (e.g., VS Code).
  • Ask Goose to take a screenshot by typing:
   Did you see the VS Code, take the screenshot
Enter fullscreen mode Exit fullscreen mode
  • To describe the screenshot, ask Goose with the following command:

    Describe this 
    /tmp/goose_screenshot_eee0a601cf1e430d8ef14c30adf123cf.jpg
    
  • The response

   The screenshot shows a dark-themed IDE with an HTML file 
   open. The HTML file   
   contains the basic structure of a webpage with a <title> and 
   <body> section,   
   which includes a header and a paragraph. The sidebar appears to 
   have a         
   directory structure visible. If you need more details, let me 
   know!
Enter fullscreen mode Exit fullscreen mode
  • Instruct goose to generate the code
implement the html code inside the index.html you just created of the screen
shoot you just captured
Enter fullscreen mode Exit fullscreen mode

The code

 <!DOCTYPE html>                                                               
 <html>                                                                        
 <head>                                                                        
     <title>My First Webpage</title>                                           
 </head>                                                                       
 <body>                                                                        
     <h1>My First Webpage</h1>                                                 
     <p>This is a paragraph...</p>                                             
 </body>                                                                       
 </html>                                                                       
Enter fullscreen mode Exit fullscreen mode
  • Finally I will ask goose to open the file in my browser
open the index.html in my chrome
Enter fullscreen mode Exit fullscreen mode

Voila it opens!!!

Image description

Using goose screen it easily simplifies your tasks, and makes you more productive

Top comments (0)