Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

javascript client #1

Closed
jung-kim opened this issue Sep 7, 2016 · 2 comments
Closed

javascript client #1

jung-kim opened this issue Sep 7, 2016 · 2 comments
Labels
type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages

Comments

@jung-kim
Copy link

jung-kim commented Sep 7, 2016

Feature request

A simple node javascript client would be awesome...
@merlimat
Copy link
Contributor

merlimat commented Sep 7, 2016

You can use the WebSocket API. Simple NodeJS examples can be found here https://github.com/yahoo/pulsar/blob/master/docs/WebSocket.md#nodejs

Though it would be nice to wrap the Pulsar WebSocket API into a NodeJS module.

@merlimat merlimat added the type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages label Sep 7, 2016
@weishengshui weishengshui mentioned this issue Sep 22, 2016
Closed
@jai1 jai1 mentioned this issue Apr 4, 2017
Closed
@sunning9001 sunning9001 mentioned this issue May 10, 2017
Closed
merlimat referenced this issue in merlimat/pulsar Jul 6, 2017
@merlimat
Added instructions for PyPI install (#1)
9ae8596
merlimat pushed a commit that referenced this issue Mar 4, 2018
@sijie
Create pulsar-functions module (#1)
72092c4 
* Create pulsar-functions module

* rename `sdk` package to `api`
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Instance (#3)
a13d5ce 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Added a simple Instance to run the exposed user interfaces

* Addressed pr comments plus added tests

* Remove unused import
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Spawner (#11)
e30808c 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Added the first cut of the Spawner

* Added more func

* Use already existing FunctionConfig

* ompiling version

* Rationalized the use of data structures

* Completed Spawner

* Fixed the unittest
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Bugcix (#12)
5e76557 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Make Spawner class public, Use Lombok for getter/setter
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Add examples (#14)
bb6409f 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Added a simple example
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Fix bugs (#15)
da4957b 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* 1. Start only when there is a subscriber
2. subscription is shared
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Minor stuff (#17)
5b0ed1b 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Added join interface to Spawner.
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Refactor (#18)
52c9c24 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Refactored serialization/deserialization into an interface
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Simplestringserde (#19)
85e1882 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Added a simple String based serde
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Opt (#22)
9766676 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Don't wait for the result. Instead chain it via CompletedFuture
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Cleanup (#23)
fc1f71c 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Cleaned up the logic of supported types
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Fix tests (#24)
5f3b93e 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Fix void type handling
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Buffer limit (#25)
f883f16 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Added a way to limit the number of outstanding tuples read but still not executed
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
System exception (#26)
117f816 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Introduced the concept of systemException to differentiate from userException
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Refactor cli (#27)
f026ef8 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Refactor cli to establish a base FunctionCommand interface that all subcommands can piggyback
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Nomenclature (#32)
4dd4089 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Made our function hierarchy match pulsar's

* Replace cluster with tenant
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Added Submit Function capability to the pulsar-functions cli (#33)
48d4aa4 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Added the first cut of the pulsar submit

* Working
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Fix compilation (#35)
da66b2d 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Fix compilation issue
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Asyncack (#37)
7fbe342 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Made ack async
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Nonthreadpool (#38)
e90b308 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* In case of Kstream style running, we dont need to spawn a executor service to run the message

* Update comment
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Reconcile (#40)
4b4bea7 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Reconciled the interface between worker and client with Jerry

* Fixed the update method
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Made Update a put request (#41)
a1b1ea5 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Adhere to rest semantics
merlimat pushed a commit that referenced this issue Mar 4, 2018
@srkukarni @sijie
Completecli (#43)
5077d71 
* Create pulsar-functions module (#1)

* Create pulsar-functions module

* rename `sdk` package to `api`

* Added the first cut of the Java interface for Pulsar functions (#2)

* Adhere to rest semantics

* Complete the list of functions supported by cli
@GitForLipeng GitForLipeng mentioned this issue Jan 7, 2021
Closed
sijie pushed a commit that referenced this issue Feb 9, 2021
@rdhabalia
[pulsar-function] fix possible deadlock on broker-function service st…
d654d5e 
…artup (#9499)

### Motivation

Standalone pulsar broker and function service can have deadlock which also sometime causes failures in function unit-test case. Pulsar function tries to create a subscription which blocks the zk thread and can be cause of possible deadlock. Below is the thread-dump when the deadlock happens and function service start up fails. 

So, remove blocking call while creating subscription using admin-api.



```

"pulsar-load-manager-139-1" #717 prio=5 os_prio=31 tid=0x00007f8a68698000 nid=0x3610f waiting on condition [0x00007000156e9000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x0000000792a07020> (a java.util.concurrent.CompletableFuture$Signaller)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1709)
        at java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323)
        at java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1788)
        at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1928)
        at org.apache.pulsar.zookeeper.ZooKeeperDataCache.get(ZooKeeperDataCache.java:97)
        at org.apache.pulsar.broker.loadbalance.impl.SimpleLoadManagerImpl.getDynamicConfigurationFromZK(SimpleLoadManagerImpl.java:391)
        at org.apache.pulsar.broker.loadbalance.impl.SimpleLoadManagerImpl.getDynamicConfigurationDouble(SimpleLoadManagerImpl.java:401)
        at org.apache.pulsar.broker.loadbalance.impl.SimpleLoadManagerImpl.getLoadBalancerBrokerOverloadedThresholdPercentage(SimpleLoadManagerImpl.java:450)
        at org.apache.pulsar.broker.loadbalance.impl.SimpleLoadManagerImpl.generateLoadReportForcefully(SimpleLoadManagerImpl.java:1139)
        - locked <0x000000078e53f2d0> (a java.util.HashSet)
        at org.apache.pulsar.broker.loadbalance.impl.SimpleLoadManagerImpl.writeLoadReportOnZookeeper(SimpleLoadManagerImpl.java:1295)
        at org.apache.pulsar.broker.loadbalance.LoadReportUpdaterTask.run(LoadReportUpdaterTask.java:39)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
        at java.lang.Thread.run(Thread.java:748)



"pulsar-ordered-OrderedExecutor-1-0-EventThread" #621 daemon prio=5 os_prio=31 tid=0x00007f89fd8e1800 nid=0x2fe07 waiting on condition [0x000070000f7ce000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x0000000792ecb8b0> (a java.util.concurrent.CompletableFuture$Signaller)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707)
        at java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323)
        at java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742)
        at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
        at org.apache.pulsar.broker.admin.impl.PersistentTopicsBase.internalCreateSubscriptionForNonPartitionedTopic(PersistentTopicsBase.java:2060)
        at org.apache.pulsar.broker.admin.impl.PersistentTopicsBase.lambda$69(PersistentTopicsBase.java:2034)
        at org.apache.pulsar.broker.admin.impl.PersistentTopicsBase$$Lambda$676/1709042625.accept(Unknown Source)
        at java.util.concurrent.CompletableFuture.uniAccept(CompletableFuture.java:670)
        at java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java:646)
        at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
        at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
        at org.apache.pulsar.zookeeper.ZooKeeperCache.lambda$5(ZooKeeperCache.java:249)
        at org.apache.pulsar.zookeeper.ZooKeeperCache$$Lambda$154/5998675.processResult(Unknown Source)
        at org.apache.bookkeeper.zookeeper.ZooKeeperClient$15$1.processResult(ZooKeeperClient.java:879)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:583)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510)


main" #1 prio=5 os_prio=31 tid=0x00007f8aa0013000 nid=0x1603 waiting on condition [0x0000700004160000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000007930efe68> (a java.util.concurrent.CompletableFuture$Signaller)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707)
        at java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323)
        at java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742)
        at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
        at org.apache.pulsar.client.admin.internal.http.AsyncHttpConnector.apply(AsyncHttpConnector.java:178)
        at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:297)
        at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$1(JerseyInvocation.java:632)
        at org.glassfish.jersey.client.JerseyInvocation$$Lambda$672/237755480.call(Unknown Source)
        at org.glassfish.jersey.client.JerseyInvocation.call(JerseyInvocation.java:654)
        at org.glassfish.jersey.client.JerseyInvocation.lambda$runInScope$3(JerseyInvocation.java:648)
        at org.glassfish.jersey.client.JerseyInvocation$$Lambda$673/197134325.call(Unknown Source)
        at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
        at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
        at org.glassfish.jersey.internal.Errors.process(Errors.java:205)
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:390)
        at org.glassfish.jersey.client.JerseyInvocation.runInScope(JerseyInvocation.java:648)
        at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:631)
        at org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:434)
        at org.glassfish.jersey.client.JerseyInvocation$Builder.put(JerseyInvocation.java:318)
        at org.apache.pulsar.client.admin.internal.TopicsImpl.createSubscription(TopicsImpl.java:1143)
        at org.apache.pulsar.functions.worker.PulsarWorkerService.start(PulsarWorkerService.java:454)
        at org.apache.pulsar.broker.PulsarService.startWorkerService(PulsarService.java:1343)
        at org.apache.pulsar.broker.PulsarService.start(PulsarService.java:671)
        at org.apache.pulsar.io.PulsarFunctionE2ETest.setup(PulsarFunctionE2ETest.java:209)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
```
@ta1meng ta1meng mentioned this issue Feb 18, 2021
Open
@LutzWeischerFujitsu LutzWeischerFujitsu mentioned this issue Mar 17, 2021
Closed
hangc0276 referenced this issue in hangc0276/pulsar May 26, 2021
@jiazhai @sijie
A framework that leverage Pulsar to handle Kafka request (#1)
fe78a93 
- Add BrokerStarter and StandaloneStarter.
- standalone starter could receive and response api_version command.
- add unit tests for channel read.
@xiaotongwang1 xiaotongwang1 mentioned this issue Aug 4, 2021
Closed
@Anonymitaet Anonymitaet mentioned this issue Aug 11, 2021
Closed
@lhotari lhotari mentioned this issue Aug 24, 2021
Closed
@Anonymitaet Anonymitaet mentioned this issue Sep 28, 2021
Merged
1 task
This was referenced Oct 18, 2021
Merged
Merged
@iTigeroar iTigeroar mentioned this issue Nov 19, 2021
Closed
@paladin-dalao paladin-dalao mentioned this issue Jan 13, 2022
Closed
@Anonymitaet Anonymitaet mentioned this issue May 12, 2022
Closed
@momo-jun momo-jun mentioned this issue May 13, 2022
Merged
1 task
@momo-jun momo-jun mentioned this issue Jun 14, 2022
Closed
1 task
@zhcn zhcn mentioned this issue Aug 25, 2022
Closed
2 tasks
@liliang950210 liliang950210 mentioned this issue Sep 1, 2022
Closed
2 tasks
@JooHyukKim JooHyukKim mentioned this issue May 8, 2023
Merged
15 tasks
@ZHr-UChiHa ZHr-UChiHa mentioned this issue Jun 3, 2023
Open
2 tasks
@codeHardest codeHardest mentioned this issue Jul 6, 2023
Closed
2 tasks
@dongzhonghua dongzhonghua mentioned this issue Aug 11, 2023
Closed
2 tasks
@lassos lassos mentioned this issue Apr 30, 2024
Closed
@AuroraTwinkle AuroraTwinkle mentioned this issue Jun 14, 2024
Closed
3 tasks
@yyj8 yyj8 mentioned this issue Jun 15, 2024
Closed
3 tasks
@luky116 luky116 mentioned this issue Jul 7, 2024
Open
3 tasks
@ozangunalp ozangunalp mentioned this issue Sep 17, 2024
Open
3 tasks
This was referenced Sep 19, 2024
Open
Open
@heesung-sn heesung-sn mentioned this issue Oct 20, 2024
Open
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@ivankelly @merlimat @jung-kim