Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

dev->staging #91

Merged
merged 17 commits into from
Aug 12, 2023
Merged

dev->staging #91

merged 17 commits into from
Aug 12, 2023

Conversation

yunginnanet
Copy link
Owner

No description provided.

@@ -20,9 +20,10 @@ const (
// Start starts our proxy pool operations. Trying to start a running ProxyEngine will return an error.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of b23e6d - 512c58:

  • Changed the way the message is printed when the proxy pool is started before
  • Added a message when prox5 is started
  • Added a message when prox5 is resumed

@@ -60,15 +60,6 @@ func (p5 *ProxyEngine) recycling() int {

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of 6e4bf0 - a25fe3:

  • Removed code for creating a channel to store tuples
  • Changed code so that tuples are added directly to the pending list
  • Updated the recycling function to take into account the recycler shuffle status

@@ -38,15 +38,18 @@ func (s SocksLogger) Printf(format string, a ...interface{}) {

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of 0f94d4 - 390560:

  • Changed the signature of the Print method in basicPrinter to take in a variadic any argument
  • Added a check to Print to return if the argument is an empty list
  • Updated the Print method to format the argument into a string
  • Updated EnableDebug to print a message when enabled
  • Updated dbgPrint to use Printf instead of Print
  • Updated msgBadProxRate to include a check for the last announced bad proxy and to store the last announced bad proxy

@@ -68,7 +68,7 @@ type ProxyEngine struct {
stats *Statistics

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of 6f8914 - be979d:
Error: couldn't generate summary

@@ -117,13 +117,11 @@ func (p5 *ProxyEngine) stillGood(sock *Proxy) bool {
if err := p5.proxyMap.delete(sock.Endpoint); err != nil {

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of e3b924 - 9b1164:

  • Deleted code related to error handling when deleting a socket from the proxy map
  • Added a return statement to return false if the socket is not found in the proxy map
  • Added a call to a function to display an error message if the socket is ratelimited by the badProx

@@ -10,7 +10,7 @@ var dummyPool *ants.Pool

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of dc0bdc - 43c398:

  • Changed the ants.NewPool parameter from ants.WithNonblocking(true) to ants.WithNonblocking(false).

@@ -50,11 +50,14 @@ func (p5 *ProxyEngine) LoadProxyTXT(seedFile string) (count int) {
func (p5 *ProxyEngine) LoadSingleProxy(sock string) bool {

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of d537a2 - b8bd3e:

  • Added a line to print an error message if the proxy format is invalid
  • Added a line to print an error message if there is an error loading the proxy
  • Commented out a line that prints a message when a proxy is loaded

@@ -1,8 +1,6 @@
package logger

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of b28b70 - 1d7faa:

  • Removed the Print function
  • Added the Printf and Errorf functions

@@ -39,7 +39,24 @@ func (p5 *ProxyEngine) addTimeout(socksString string) string {
return socksString

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of 497766 - 262e6b:

  • Added a isEmpty() function to check if the proxy engine is empty
  • Added an ErrNoProxies error
  • Added a scale() function to scale the proxy engine
  • Modified the popSockAndLockIt function to include the new isEmpty() function
  • Added an announceDial function to print out a message when dialing
  • Modified the mysteryDialer function to include the new isEmpty() and announceDial functions

@@ -19,7 +19,7 @@ const (
)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of d1af1f - c19eab:

  • Changed the value of the ProtoNull key in the protoMap map from an empty string to the string "unknown".

@@ -0,0 +1,204 @@
package prox5

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of None - 14cc4d:

  • Set up multiple SOCKS and HTTP servers
  • Created a ProxyEngine with settings for debugging, worker count, auto scaling, and recycling
  • Made requests to the HTTP server via the ProxyEngine
  • Logged the successful responses from the HTTP server

@@ -14,7 +14,7 @@ var defaultUseProxyRatelimiter = rl.Policy{

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of c57cc3 - 9363c6:

  • Changed the Burst value in the defaultBadProxyRateLimiter policy from 5 to 10.

@@ -11,41 +11,47 @@ func (p5 *ProxyEngine) AddUserAgents(uagents []string) {
p5.mu.Lock()

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of 3f6449 - 2fa261:

  • Added logging to AddUserAgents, SetUserAgents, SetCheckEndpoints, SetStaleTime, SetValidationTimeout, SetServerTimeout, SetMaxWorkers, EnableRecycling, DisableRecycling, SetRemoveAfter, SetDialerBailout, SetDispenseMiddleware, SetLogger, SetAndEnableDebugLogger, EnableAutoScaler, DisableAutoScaler, SetAutoScalerMaxScale, SetAutoScalerThreshold, EnableDebugRedaction, DisableDebugRedaction, EnableRecyclerShuffling, DisableRecyclerShuffling, EnableHTTPClientTLSVerification, and DisableHTTPClientTLSVerification functions.
  • Added a minimum of 2 workers to SetMaxWorkers if the engine is empty.

@@ -154,13 +154,29 @@ func (hmd *handMeDown) Dial(network, addr string) (c net.Conn, err error) {
return hmd.conn, nil

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GPT summary of 7730f7 - ef156a:

  • Added a new function announceValidating() which prints out the protocol and endpoint being validated
  • Modified singleProxyCheck() to call announceValidating() and removed the call to dbgPrint()
  • Modified validate() to check for nil pointers before running the validation

@github-actions
Copy link

GPT summary of d8f03bc:

  • Added an RUnlock() call after the list.Len() check dispense.go
  • Added an RUnlock() call after the stillGood() check dispense.go
  • Added a recycling() call after the list.Len() check dispense.go
  • Added a 50 millisecond sleep after the recycling() call dispense.go

@github-actions
Copy link

GPT summary of 69187d7:

  • Removed code related to shuffling proxies when recycling daemons.go
  • Moved p5.Pending.add(tuple.Val) and count++ to the case true and case false blocks daemons.go
  • Removed code related to recycleTuples daemons.go

@github-actions
Copy link

GPT summary of 54e641f:

  • Removed redu from the recycling() function daemons.go

@github-actions
Copy link

GPT summary of 121543b:

@github-actions
Copy link

GPT summary of 5032231:

  • Deleted the proxy from the map when it is no longer good dispense.go
  • Added a return statement to the stillGood function dispense.go

@github-actions
Copy link

GPT summary of 2e85c81:

Error: couldn't generate summary

1 similar comment
@github-actions
Copy link

GPT summary of 2e85c81:

Error: couldn't generate summary

@github-actions
Copy link

GPT summary of 8497792:

Not generating summary for merge commits

1 similar comment
@github-actions
Copy link

GPT summary of 8497792:

Not generating summary for merge commits

@github-actions
Copy link

GPT summary of 39bc5ac:

@github-actions
Copy link

GPT summary of bbbc9b7:

  • Changed the way the address is written to the buffer when redacted is enabled mystery_dialer.go

@github-actions
Copy link

GPT summary of 39bc5ac:

  • Unexported mysteryDialer and replaced it with Dial, DialTimeout, and DialContext
  • Added announceDial function to print network and address when dialing
  • Added redact option to announceDial to hide address if needed
  • Removed dbgPrint call from mysteryDialer when no proxies are available
  • Changed mysteryDialer to use announceDial instead of printing directly mystery_dialer.go

@github-actions
Copy link

GPT summary of bbbc9b7:

  • Changed the buf.MustWriteString to s.MustWriteString for network and addr mystery_dialer.go
  • Added an opt.redact condition to write [redacted] instead of the address mystery_dialer.go

@github-actions
Copy link

GPT summary of 05b9e36:

  • Lowered the defaultBadProxyRateLimiter Burst from 5 to 10 proxy.go
  • Lowered the numeric tolerance for test files
  • Reduced the sleep time in the newDummyHTTPSServer and dummySOCKSServer functions prox5_test.go
  • Added the lastBadProxAnnounced variable debug.go
  • Increased the amount of workers from 1 to 10 and the auto-scaler threshold from 1 to 10 and the auto-scaler max scale from 1 to 100 prox5_test.go
  • Added an OpenAI API for completions [packages/utils/apis/openai.ts]

@github-actions
Copy link

GPT summary of 7ae3ebd:

  • Changed branches to trigger on to master and development go.yml

@github-actions
Copy link

GPT summary of 05b9e36:

  • Lowered the timeout for dummy HTTPS server from 500 to 300 milliseconds debug.go, prox5_test.go
  • Raised the amount of requests in a burst for bad proxy rate limiter from 5 to 10 proxy.go
  • Raised the max workers from 1 to 10 and the autoscale threshold from 1 to 10 with a max scale of 100 prox5_test.go
  • Added a lastBadProxAnnounced store debug.go

@github-actions
Copy link

GPT summary of 40ed287:

  • Changed the error type in TestProx5 from Fatal to Error prox5_test.go

@github-actions
Copy link

GPT summary of 7ae3ebd:

  • Changed the branches to trigger the workflow from master and dev to master and development go.yml

@github-actions
Copy link

GPT summary of 4f3c842:

@github-actions
Copy link

GPT summary of 40ed287:

  • Changed the error handling for the GetHTTPClient() method in prox5_test.go from t.Fatal() to t.Error()

@github-actions
Copy link

GPT summary of d8c0a3a:

@github-actions
Copy link

GPT summary of 4f3c842:

@github-actions
Copy link

GPT summary of 0c61142:

  • Updated go.mod and go.sum dependencies
  • Removed github.com/ysmood/gotrace dependency
  • Updated github.com/andybalholm/brotli to version 1.0.5

@github-actions
Copy link

GPT summary of d8c0a3a:

@github-actions
Copy link

GPT summary of db3eaf3:

  • Changed branch names from master to main for github action go.yml

PR summary so far:

  • Updated dependencies in go.mod and go.sum
  • Changed the workflow branches from master and dev to main and development
  • Added a Github Action for GPT Commit summarizer
  • Lowered the defaultBadProxyRateLimiter Burst from 5 to 10
  • Added logging to various functions
  • Changed the Burst value in the defaultBadProxyRateLimiter policy from 5 to 10
  • Added a announceDial function to print out a message when dialing
  • Added a check to Print to return if the argument is an empty list
  • Updated Print method to format the argument into a string
  • Updated msgBadProxRate to include a check for the last announced bad proxy and to store the last announced bad proxy
  • Changed the way the address is written to the buffer when redacted is enabled

@github-actions
Copy link

GPT summary of 0c61142:

PR summary so far:

  • Changed the logic for returning a SOCKS proxy from a list
  • Added a Github action for GPT commit summarizer
  • Updated dependencies and removed the gotrace dependency
  • Updated the way messages are printed when the proxy pool is started
  • Changed the branches that the workflow should run on
  • Updated the error handling for the GetHTTPClient() method
  • Lowered the timeout for dummy HTTPS server and raised the amount of requests in a burst for bad proxy rate limiter
  • Raised the max workers and autoscale threshold with a max scale of 100
  • Added a lastBadProxAnnounced store
  • Added logging to various setter functions

@github-actions
Copy link

GPT summary of a1c31c9:

Not generating summary for merge commits

PR summary so far:

  • Updated dependencies and branch names
  • Changed the logic for returning a SOCKS proxy from a list
  • Added a Github Action for GPT Commit summarizer
  • Added an OpenAI API for completions
  • Lowered the defaultBadProxyRateLimiter Burst from 5 to 10
  • Increased the amount of workers from 1 to 10 and the auto-scaler threshold from 1 to 10 and the auto-scaler max scale from 1 to 100
  • Changed the error type in TestProx5 from Fatal to Error
  • Added logging to various setter functions
  • Added a announceDial function to print out a message when dialing
  • Changed the Burst value in the defaultBadProxyRateLimiter policy from 5 to 10.

@yunginnanet yunginnanet merged commit 471f769 into main Aug 12, 2023
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant