Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / ZhaoYis / Berry.Spider

基于Selenium自动化框架实现的爬虫程序（目前主要有百度、头条、搜狗）

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ZhaoYis%2FBerry.Spider

Stars: 8
Forks: 3
Open Issues: 1

License: mit
Language: C#
Repo Size: 21.2 MB
Dependencies: 202

Created: about 2 years ago
Updated: 4 days ago
Last pushed: 4 days ago
Last synced: 4 days ago

Topics: abp-vnext, chrome, csharp, selenium, webdriver

Files

Loading...

Readme

Loading...

Dependencies

.github/workflows/consumer_build.yml actions

actions/checkout v2 composite
actions/create-release v1 composite
actions/setup-dotnet v1 composite
actions/upload-artifact v2 composite
actions/upload-release-asset v1 composite
chf007/action-wechat-work master composite

doc/agile_config.docker-compose.yml docker

kklldog/agile_config latest

doc/mongo.docker-compose.yml docker

mongo latest
mongo-express latest

doc/mongodb_cluster_with-keyfile-auth/docker-compose.yml docker

jin-mongo 6.0.2

doc/mongodb_cluster_with-keyfile-auth/mongodb-build/Dockerfile docker

mongo 6.0.2 build

host/Berry.Spider.HttpApi.Host/Berry.Spider.HttpApi.Host.csproj nuget

src/Berry.Spider.Abstractions/Berry.Spider.Abstractions.csproj nuget

Volo.Abp.Core 7.1.1

src/Berry.Spider.Application/Berry.Spider.Application.csproj nuget

src/Berry.Spider.AspNetCore.Mvc/Berry.Spider.AspNetCore.Mvc.csproj nuget

src/Berry.Spider.Baidu/Berry.Spider.Baidu.csproj nuget

Volo.Abp.Core 7.1.1
Volo.Abp.Ddd.Application 7.1.1

src/Berry.Spider.Baidu.Contracts/Berry.Spider.Baidu.Contracts.csproj nuget

Volo.Abp.Core 7.1.1
Volo.Abp.Ddd.Application.Contracts 7.1.1

src/Berry.Spider.Consumers/Berry.Spider.Consumers.csproj nuget

AgileConfig.Client 1.6.12
Microsoft.Extensions.Hosting 7.0.1
Serilog.Extensions.Hosting 5.0.1
Serilog.Extensions.Logging 3.1.0
Serilog.Settings.Configuration 3.4.0
Serilog.Sinks.Async 1.5.0
Serilog.Sinks.Console 4.1.0
Serilog.Sinks.File 5.0.0
Volo.Abp.Autofac 7.1.1
Volo.Abp.BackgroundWorkers 7.1.1
Volo.Abp.BackgroundWorkers.Quartz 7.1.1
Volo.Abp.Core 7.1.1

src/Berry.Spider.Contracts/Berry.Spider.Contracts.csproj nuget

Microsoft.AspNetCore.Http 2.2.2
Volo.Abp.Core 7.1.1
Volo.Abp.Ddd.Application.Contracts 7.1.1

src/Berry.Spider.Core/Berry.Spider.Core.csproj nuget

DotNetCore.NPOI 1.2.3
Microsoft.Extensions.ObjectPool 7.0.4
Selenium.WebDriver 4.8.2
ToolGood.Words 3.1.0
Volo.Abp.Caching.StackExchangeRedis 7.1.1
Volo.Abp.Core 7.1.1
Volo.Abp.Guids 7.1.1
Volo.Abp.TextTemplating 7.1.1

src/Berry.Spider.Domain/Berry.Spider.Domain.csproj nuget

Volo.Abp.Core 7.1.1
Volo.Abp.Ddd.Domain 7.1.1

src/Berry.Spider.Domain.Shared/Berry.Spider.Domain.Shared.csproj nuget

Volo.Abp.Core 7.1.1

src/Berry.Spider.EntityFrameworkCore/Berry.Spider.EntityFrameworkCore.csproj nuget

Microsoft.EntityFrameworkCore.Tools 7.0.4 development
Microsoft.EntityFrameworkCore 7.0.4
Microsoft.EntityFrameworkCore.Relational 7.0.4
Volo.Abp.Core 7.1.1
Volo.Abp.Dapper 7.1.1
Volo.Abp.EntityFrameworkCore 7.1.1
Volo.Abp.EntityFrameworkCore.MySQL 7.1.1

src/Berry.Spider.EventBus/Berry.Spider.EventBus.csproj nuget

Volo.Abp.Core 7.1.1

src/Berry.Spider.EventBus.MongoDB/Berry.Spider.EventBus.MongoDB.csproj nuget

Volo.Abp.Core 7.1.1
Volo.Abp.MongoDB 7.1.1

src/Berry.Spider.EventBus.RabbitMq/Berry.Spider.EventBus.RabbitMq.csproj nuget

src/Berry.Spider.FileDownloader.Mmonly/Berry.Spider.FileDownloader.Mmonly.csproj nuget

src/Berry.Spider.FreeRedis/Berry.Spider.FreeRedis.csproj nuget

FreeRedis 1.0.8
Volo.Abp.Core 7.1.1

src/Berry.Spider.HttpApi/Berry.Spider.HttpApi.csproj nuget

Volo.Abp.AspNetCore.Mvc 7.1.1
Volo.Abp.Core 7.1.1

src/Berry.Spider.Mmonly/Berry.Spider.Mmonly.csproj nuget

src/Berry.Spider.Mmonly.Contracts/Berry.Spider.Mmonly.Contracts.csproj nuget

Volo.Abp.Ddd.Application.Contracts 7.1.1

src/Berry.Spider.OpenAI/Berry.Spider.OpenAI.csproj nuget

Betalgo.OpenAI.GPT3 6.8.3
Volo.Abp.Core 7.1.1

src/Berry.Spider.OpenAI.Application/Berry.Spider.OpenAI.Application.csproj nuget

Volo.Abp.Core 7.1.1
Volo.Abp.Ddd.Application 7.1.1

src/Berry.Spider.OpenAI.Contracts/Berry.Spider.OpenAI.Contracts.csproj nuget

Volo.Abp.Core 7.1.1
Volo.Abp.Ddd.Application.Contracts 7.1.1

src/Berry.Spider.Proxy/Berry.Spider.Proxy.csproj nuget

Volo.Abp.Core 7.1.1

src/Berry.Spider.Proxy.Abstractions/Berry.Spider.Proxy.Abstractions.csproj nuget

Volo.Abp.Core 7.1.1

src/Berry.Spider.Proxy.Local/Berry.Spider.Proxy.Local.csproj nuget

src/Berry.Spider.Proxy.QgNet/Berry.Spider.Proxy.QgNet.csproj nuget

src/Berry.Spider.Pull.Consumers/Berry.Spider.Pull.Consumers.csproj nuget

src/Berry.Spider.Push.Consumers/Berry.Spider.Push.Consumers.csproj nuget

src/Berry.Spider.Segmenter/Berry.Spider.Segmenter.csproj nuget

Volo.Abp.Core 7.1.1

src/Berry.Spider.Segmenter.JiebaNet/Berry.Spider.Segmenter.JiebaNet.csproj nuget

Volo.Abp.Core 7.1.1
jieba.NET 0.42.2

src/Berry.Spider.Sogou/Berry.Spider.Sogou.csproj nuget

Volo.Abp.Core 7.1.1
Volo.Abp.Ddd.Application 7.1.1

src/Berry.Spider.Tools.BuildSMData/Berry.Spider.Tools.BuildSMData.csproj nuget

src/Berry.Spider.Tools.ExcelFileToDb/Berry.Spider.Tools.ExcelFileToDb.csproj nuget

src/Berry.Spider.Tools.JsonFileToDb/Berry.Spider.Tools.JsonFileToDb.csproj nuget

src/Berry.Spider.Tools.ServDetector/Berry.Spider.Tools.ServDetector.csproj nuget

AgileConfig.Client 1.6.12
Microsoft.Extensions.Hosting 7.0.1
Serilog.Extensions.Hosting 5.0.1
Serilog.Extensions.Logging 3.1.0
Serilog.Sinks.Async 1.5.0
Serilog.Sinks.Console 4.1.0
Serilog.Sinks.File 5.0.0
Volo.Abp.Autofac 7.1.1
Volo.Abp.BackgroundWorkers.Quartz 7.1.1

src/Berry.Spider.Tools.SyncToRedis/Berry.Spider.Tools.SyncToRedis.csproj nuget

src/Berry.Spider.Tools.TxtFileToDb/Berry.Spider.Tools.TxtFileToDb.csproj nuget

src/Berry.Spider.TouTiao/Berry.Spider.TouTiao.csproj nuget

Volo.Abp.Core 7.1.1
Volo.Abp.Ddd.Application 7.1.1

src/Berry.Spider.TouTiao.Contracts/Berry.Spider.TouTiao.Contracts.csproj nuget

Microsoft.AspNetCore.Http 2.2.2
Volo.Abp.Core 7.1.1

src/Berry.Spider.Weixin/Berry.Spider.Weixin.csproj nuget

Volo.Abp.Core 7.1.1

src/Berry.Spider.Weixin.Work/Berry.Spider.Weixin.Work.csproj nuget

Refit 6.3.2
Refit.HttpClientFactory 6.3.2
Volo.Abp.Core 7.1.1

src/Berry.Spider.XxlJob/Berry.Spider.XxlJob.csproj nuget

src/Berry.Spider.XxlJob.JobHandler/Berry.Spider.XxlJob.JobHandler.csproj nuget

Volo.Abp.Core 7.1.1

test/Berry.Spider.Tests/Berry.Spider.Tests.csproj nuget

Microsoft.NET.Test.Sdk 17.5.0
Moq 4.18.4
Shouldly 4.1.0
coverlet.collector 3.2.0
xunit 2.4.2
xunit.runner.visualstudio 2.4.5