What’s included in flow-scrape?
Flow Scrape provides a comprehensive platform for creating, managing, and executing automated workflows. It features a drag-and-drop workflow builder, real-time execution tracking, and integrations with popular services.
Tech Stack
- Next.js: The React framework for production.
- TypeScript: JavaScript with syntax for types.
- Prisma: Next-generation ORM for TypeScript & Node.js.
- PostgreSQL: Advanced open source relational database.
- Stripe: Payment processing for internet businesses.
- Tailwind CSS: A utility-first CSS framework.
- shadcn/ui: Re-usable components built on Radix UI and Tailwind CSS.
- NextAuth.js: Complete open source authentication solution.
Features
- Workflow Builder: Drag-and-drop interface to create custom workflows
- Node-Based Editor: Visual workflow editor with various node types
- Execution Engine: Run workflows with real-time progress tracking
- User Authentication: Secure user management with NextAuth.js
- Billing Integration: Stripe-powered subscription management
- Credential Management: Secure storage of API keys and credentials
- Analytics Dashboard: Track workflow performance and usage
- Responsive Design: Modern UI built with Tailwind CSS and shadcn/ui
Prerequisites
- Node.js 18+
- PostgreSQL database
- Stripe account for payments
Installation
- Clone the repository:
git clone https://github.com/bjornleonhenry/flow-scrape.git
cd flow-scrape
- Install dependencies:
npm install
# or
pnpm install
- Set up environment variables:
cp .env.example .env.local
Fill in the required environment variables:
DATABASE_URL
: Your PostgreSQL connection stringNEXTAUTH_SECRET
: Random secret for NextAuth.jsNEXTAUTH_URL
: Your app’s URLSTRIPE_PUBLISHABLE_KEY
: Stripe publishable keySTRIPE_SECRET_KEY
: Stripe secret keySTRIPE_WEBHOOK_SECRET
: Stripe webhook secret
- Set up the database:
npx prisma generate
npx prisma db push
- Run the development server:
npm run dev
# or
pnpm run dev
Open http://localhost:3000 to see the application.
Project Structure
├── app/ # Next.js app directory
│ ├── (auth)/ # Authentication pages
│ ├── (dashboard)/ # Dashboard pages
│ ├── api/ # API routes
│ └── globals.css # Global styles
├── components/ # Reusable components
│ ├── ui/ # shadcn/ui components
│ └── ... # Custom components
├── lib/ # Utility functions and configurations
├── prisma/ # Database schema and migrations
├── public/ # Static assets
└── types/ # TypeScript type definitions
Contributing to flow-scrape
Contributions are welcomed, and appreciated. If you have a feature request, please add it as an issue or make a pull request.